Agent Ready Crawlers

The field guide to every AI crawler and agent at the door, and the vendors who decide who gets in.

Browsing agent from Browserbase

Browserbase cloud browsers

In short

Browserbase cloud browsers is Browserbase's browsing agent. Browserbase cloud browsers has no robots.txt token, so robots.txt cannot address it and the crawl cannot measure a block rate. It signs requests with Web Bot Auth, so a signature can be checked. Browserbase cloud browsers has no operator bot documentation, checked 2026-11-04. Part of Cloudflare's first signed-agents cohort (2025-08-28).

Operator
Browserbase Vendor profile: Browserbase
Purpose
Task agent All task agent rows. A browsing agent that clicks, fills forms and finishes a job for a person.
User-agent string
No exact string is published. What the operator or a third party says: Signed with Web Bot Auth for customers who enable it
robots.txt token
None. No robots.txt line can address this agent.
Respects robots.txt

No documentation

operator publishes no bot documentation (checked 2026-11-04) on robots.txt; Browserbase sessions follow the customer's code. Source, read 2026-11-04.

Operator publishes no bot documentation (checked 2026-11-04).

Verification

Web Bot Auth signature

Requests carry an HTTP message signature that can be checked against the operator's published key directory. Documentation, read 2026-11-04.

IP ranges
Not published.
Rate behaviour
Set by the customer.
Block rate

None: the agent has no token, so a robots.txt block rate does not exist.

Documentation
Operator publishes no bot documentation (checked 2026-11-04). Closest page read.

Note. Part of Cloudflare's first signed-agents cohort (2025-08-28). Key directory served 2026-11-04. Browserbase also sells a "Verified" browser with real fingerprints, so unsigned sessions are hard to tell apart.

Allow and refuse lines

This agent has no robots.txt token, so there are no lines to copy. Verify its signature in your WAF or edge rules instead, then allow or refuse the verified identity.

Refusing or allowing in robots.txt states a preference. For this row the operator or its documentation says robots.txt may not govern the fetch, so enforcement belongs in your WAF.

Browserbase in the Verification Ledger

Key directory; signing is a customer feature. All operators.

IP lists
publishes nothing
Reverse DNS
publishes nothing
Key directory
https://www.browserbase.com/.well-known/http-message-signatures-directory
Cloudflare
Cloudflare signed agent (cohort of 2025-08-28)
Visa TAP registry
no public operator-level registration found (checked 2026-11-04)
Mastercard Agent Pay
no public operator-level registration found (checked 2026-11-04)

Other Browserbase rows

Sources

Last reviewed 2026-11-04