---
title: "Anthropic refreshes its crawler IP list | Agent Ready Crawlers"
description: "Anthropic refreshes its crawler IP list. Anthropic warns that IP blocking may stop its bots reading robots.txt. Dated 2026-10-20."
canonical: https://agentreadycrawlers.com/news/2026-10-20-anthropic-refreshes-its-crawler-ip-list
site: "Agent Ready Crawlers"
last_updated: 2026-11-04
date: 2026-10-20
section: "News"
---

# Anthropic refreshes its crawler IP list | Agent Ready Crawlers

> Anthropic refreshes its crawler IP list. Anthropic warns that IP blocking may stop its bots reading robots.txt. Dated 2026-10-20.

Source: https://agentreadycrawlers.com/news/2026-10-20-anthropic-refreshes-its-crawler-ip-list
Site: Agent Ready Crawlers
Last reviewed: 2026-11-04

News from 2026-10-20

# Anthropic refreshes its crawler IP list

In short

20 October 2026: Anthropic refreshes its crawler IP list. claude.com/crawling/bots.json, the list Anthropic links for verifying ClaudeBot, Claude-User and Claude-SearchBot, carried creationTime 2026-10-20 when read, starting with 216.73.216.0/22. Anthropic warns that IP blocking may stop its bots reading robots.txt. Claude-User is Anthropic's live answer fetcher. Rows affected in this site: ClaudeBot, Claude-User and Claude-SearchBot.

claude.com/crawling/bots.json, the list Anthropic links for verifying ClaudeBot, Claude-User and Claude-SearchBot, carried creationTime 2026-10-20 when read, starting with 216.73.216.0/22. Anthropic warns that IP blocking may stop its bots reading robots.txt.

Primary source [claude.com/crawling/bots.json](https://claude.com/crawling/bots.json), read 2026-11-04.

## Also read

-   [Anthropic support: does Anthropic crawl data from the web, and how can site owners block the crawler](https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler). Anthropic says blocking the IP addresses its bots operate from may not work correctly or persistently guarantee an opt-out, because it impedes its ability to read your robots.txt. Read 2026-11-04.

## Where it stands in the Index

[ClaudeBot](https://agentreadycrawlers.com/crawlers/claudebot/)

Anthropic, training. Token `ClaudeBot`. Verification: ip list. Refused by 17.6% of top-10,000 sites.

[Claude-User](https://agentreadycrawlers.com/crawlers/claude-user/)

Anthropic, live answer fetch. Token `Claude-User`. Verification: ip list. Refused by 8.1% of top-10,000 sites.

[Claude-SearchBot](https://agentreadycrawlers.com/crawlers/claude-searchbot/)

Anthropic, search index. Token `Claude-SearchBot`. Verification: ip list. Refused by 7.7% of top-10,000 sites.

[All news](https://agentreadycrawlers.com/news/).

## Sources

-   [claude.com: bots (JSON)](https://claude.com/crawling/bots.json) read 2026-11-04
-   [Anthropic support: does Anthropic crawl data from the web, and how can site owners block the crawler](https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler) read 2026-11-04

Last reviewed 2026-11-04
