100 terabytes
100 TBData · definition
Decimal kB, MB and GB use powers of 1,000. KiB, MiB and GiB use powers of 1,024. The content of a file depends on encoding and compression.
Data & storage
Archives
BYTES OF DATA
Decimal kB, MB and GB use powers of 1,000.
The Common Crawl monthly web snapshot is a large, publicly available collection of web pages and related data gathered by automated crawlers each month.
A little perspective
100 terabytes is about 1.1 times the compressed WARC data of the Common Crawl June 2025 WARC snapshot.
Data: 100 TB; definition.
Decimal kB, MB and GB use powers of 1,000. KiB, MiB and GiB use powers of 1,024. The content of a file depends on encoding and compression.
Compressed WARC data: 91 TB; specified; range 90 TB–92 TB.
The June 2025 Common Crawl release reports 82.73 TiB of compressed WARC captures, about 91 trillion bytes. WAT, WET, indexes and uncompressed content are separate.
Common Crawl — June 2025 crawl archive
The marked compressed WARC data is calibrated. Unmeasured illustration details are representative.
Measurement details
Compare 100 terabytes with the compressed WARC data of the Common Crawl June 2025 WARC snapshot. The notes below explain how each value was chosen.
Data · definition
Decimal kB, MB and GB use powers of 1,000. KiB, MiB and GiB use powers of 1,024. The content of a file depends on encoding and compression.
Compressed WARC data · specified · range 90 TB–92 TB
The June 2025 Common Crawl release reports 82.73 TiB of compressed WARC captures, about 91 trillion bytes. WAT, WET, indexes and uncompressed content are separate.
The diagram uses the recorded measurements. Details outside the marked spans do not set the scale.
Data size depends on encoding and compression; decimal GB and binary GiB are different units.
Change your perspective
Choose a suggestion to redraw the comparison, or open its page to learn what it is.
A little smaller. A little larger.