Common Crawl (CCBot) IP Ranges
Common Crawl is a nonprofit that crawls the web and publishes the result as a free archive, which researchers and many AI developers use as training data. Its crawler, CCBot, works from a very small footprint: four IPv4 prefixes, 28 addresses in all, and a single IPv6 /56. Every one of them is on Amazon's AS14618, so the crawler runs on AWS and WHOIS names Amazon, not Common Crawl.
- Provider
- Common Crawl (CCBot)
- Hosting network
- AS14618 (Amazon AWS, host)
- Category
- Crawler
- Headquarters
- United States (nonprofit foundation)
- Published IPv4 prefixes
- 4
- Registry
- Self-published list
Known IP ranges
Common Crawl does not announce these addresses under an ASN of its own. They are the prefixes it publishes in https://index.commoncrawl.org/ccbot.json, as fetched on 2026-10-16; the space itself is routed by AS14618 (Amazon AWS). The list decides whether an address belongs to Common Crawl (CCBot) - WHOIS for any of them returns the host network.
3.41.188.32/29
18.97.9.168/29
18.97.14.80/29
18.97.14.88/30
2600:1f28:365:8000::/56 (IPv6)
What does a Common Crawl (CCBot) IP mean in a privacy test?
A CCBot address is Common Crawl's archive crawler, not a person. Blocking it keeps pages out of future Common Crawl snapshots, which is also how many site owners keep their content out of datasets built from them.
Four blocks and one IPv6 /56
The list is published at index.commoncrawl.org/ccbot.json. Fetched on 16 October 2026, its creationTime read 11 August 2026. It holds three /29s and one /30, starting with 3.41.188.32/29, which together come to 28 IPv4 addresses, and one IPv6 /56.
That is a deliberately narrow footprint for a crawler whose archive runs to billions of pages per snapshot: Common Crawl crawls from a handful of AWS hosts rather than spreading across a wide range, which makes the list easy to allow or block exactly.
Why CCBot matters more than its size
CCBot's output is reused far beyond Common Crawl itself. Its snapshots are public, and datasets built from them have been used to train many language models, so for a site owner deciding about AI crawlers, CCBot is an indirect route their pages can take into training data even when the AI companies' own crawlers are blocked.
On the network it shares AS14618 with PerplexityBot and with every other AWS customer, so an Amazon address proves nothing by itself. The four prefixes and the /56 in the published list are what identify CCBot.
Related tools
Frequently asked questions
What IP ranges does Common Crawl's CCBot use?
Three /29s and one /30 in IPv4, 28 addresses, plus one IPv6 /56, as listed in index.commoncrawl.org/ccbot.json, all on Amazon's AS14618.
Why does a CCBot address appear in my logs or a privacy test?
A CCBot address is Common Crawl's archive crawler, not a person. Blocking it keeps pages out of future Common Crawl snapshots, which is also how many site owners keep their content out of datasets built from them.
Why does WHOIS say Amazon for a CCBot address?
Common Crawl runs its crawler on AWS and publishes the addresses it uses. The registry describes the network owner, which for every CCBot prefix is Amazon's AS14618.
Does blocking CCBot keep my site out of AI training data?
It keeps your pages out of future Common Crawl snapshots, which many training datasets are built from. It does not affect copies already in earlier snapshots, or AI crawlers that collect pages themselves.
Is Common Crawl a company?
It is a nonprofit foundation. It publishes its web archive for free; the crawler exists to build that archive, not a search engine.