Agent Ready Crawlers

The field guide to every AI crawler and agent at the door, and the vendors who decide who gets in.

Glossary

Signed agent

In short

Cloudflare's class for agents directed by end users whose requests are signed with Web Bot Auth and who follow its signed agent policy. Rows marked Cloudflare signed agent in the Index verify this way; the profile of each says what was read. Example: The first signed-agent cohort on 2025-08-28: ChatGPT agent, Goose, Browserbase and Anchor Browser.

Definition

Cloudflare's class for agents directed by end users whose requests are signed with Web Bot Auth and who follow its signed agent policy.

Sourced example

The first signed-agent cohort on 2025-08-28: ChatGPT agent, Goose, Browserbase and Anchor Browser. Source, read 2026-11-04.

How it shows up here

Rows marked Cloudflare signed agent in the Index verify this way; the profile of each says what was read.

Previous: Signature-Agent header. Next: Spoofed crawler. All 41 terms.

Sources

Last reviewed 2026-11-04