Agent Ready Crawlers

The field guide to every AI crawler and agent at the door, and the vendors who decide who gets in.

Browsing agent from Anthropic

Claude Duet cloud browser

In short

Claude Duet cloud browser is Anthropic's browsing agent. The token to write in robots.txt is Claude-Agent. The operator publishes nothing a site can check. The crawl of 2026-11-04 did not measure Claude-Agent. On robots.txt, Verisoul reports Anthropic says the agent aims to follow site rules; Anthropic's crawler page does not list it (checked 2026-11-04).

Operator
Anthropic Vendor profile: Anthropic
Purpose
Task agent All task agent rows. A browsing agent that clicks, fills forms and finishes a job for a person.
User-agent string
No exact string is published. What the operator or a third party says: Linux Chrome string with a "compatible; Claude-Agent/1.0" token, as observed by Verisoul (secondary)
robots.txt token
Claude-Agent Matched case-insensitively (RFC 9309). The token and the user-agent string are different things.
Respects robots.txt

Reported by a third party

Verisoul reports Anthropic says the agent aims to follow site rules; Anthropic's crawler page does not list it (checked 2026-11-04). Source, read 2026-11-04.

Verification

Nothing published

The operator publishes no list, reverse DNS pattern or key directory a site owner can check. Documentation, read 2026-11-04.

IP ranges
Not published.
Rate behaviour
Not published.
Block rate

Not measured: the crawl checked 31 AI and search tokens, and Claude-Agent is not one of them.

Documentation
verisoul.ai, read 2026-11-04.

Note. Duet launched 2026-10-21 as a waitlist research preview for US Pro and Max subscribers, per Verisoul. Token taken from observed traffic, not an Anthropic page; treat as unconfirmed.

Allow and refuse lines

To allow Claude-Agent

User-agent: Claude-Agent
Allow: /

To refuse Claude-Agent

User-agent: Claude-Agent
Disallow: /

Refusing or allowing in robots.txt states a preference. For this row the operator or its documentation says robots.txt may not govern the fetch, so enforcement belongs in your WAF.

Anthropic in the Verification Ledger

One shared IP list for all three bots; no key directory at claude.ai or claude.com (404, 2026-11-04); nothing for Claude in Chrome. All operators.

IP lists
Reverse DNS
publishes nothing
Key directory
publishes nothing
Cloudflare
not confirmed on Radar (directory slug not found, 2026-11-04)
Visa TAP registry
no public operator-level registration found (checked 2026-11-04)
Mastercard Agent Pay
no public operator-level registration found (checked 2026-11-04)

In the news

Other Anthropic rows

Sources

Last reviewed 2026-11-04