Anthropic: 7 rows
In short
Anthropic has 7 rows in the Index: ClaudeBot, Claude-User, Claude-SearchBot, anthropic-ai, Claude in Chrome, Claude Duet cloud browser and Claude computer use. They cover 4 purposes: training, live answer fetch, search index, task agent. 5 of them have a robots.txt token and 4 publish nothing a site can verify.
| Operator | Token | Block rate |
|---|---|---|
| Anthropic | ClaudeBot | 17.6% |
| Anthropic | Claude-User | 8.1% |
| Anthropic | Claude-SearchBot | 7.7% |
| Anthropic | anthropic-ai | 15.5% |
| Anthropic | Claude in Chrome | |
| Anthropic | Claude-Agent | |
| Anthropic | Claude computer use (API tool) |
Vendor profile: Anthropic, with its products, standards, our probes and what it does not do.
Verification Ledger entry
- Summary
- One shared IP list for all three bots; no key directory at claude.ai or claude.com (404, 2026-11-04); nothing for Claude in Chrome.
- IP lists
- Reverse DNS
- publishes nothing
- Key directory
- publishes nothing
- Cloudflare
- not confirmed on Radar (directory slug not found, 2026-11-04)
- Visa and Mastercard
- Visa TAP: no public operator-level registration found (checked 2026-11-04). Mastercard Agent Pay: no public operator-level registration found (checked 2026-11-04).
Block rates for Anthropic tokens
| Token | Refused, top 10,000 | Named | Via * | All crawled |
|---|---|---|---|---|
| ClaudeBot | 17.6% | 14.0% | 3.5% | 13.1% |
| anthropic-ai | 15.5% | 11.7% | 3.8% | 11.6% |
| Claude-User | 8.1% | 4.5% | 3.6% | 5.7% |
| Claude-SearchBot | 7.7% | 4.1% | 3.6% | 5.5% |
Based on 5,938 top-10,000 sites with a parsed robots.txt; crawl of 2026-11-04.
In the news
- 2026-10-21Anthropic's Claude Duet starts browsing with a Claude-Agent token
- 2026-10-20Anthropic refreshes its crawler IP list
Sources
Last reviewed 2026-11-04