Agent Ready Crawlers

The field guide to every AI crawler and agent at the door, and the vendors who decide who gets in.

Glossary

Accountable designation

In short

Cloudflare's label for crawler operators that offer a training opt-out, an AI-summary opt-out, URL-level visibility, and an assurance that opting out of training does not affect search. Cloudflare applied the label on 2026-09-15 to Apple, Google and Microsoft as mixed-use crawlers, and to Amazon, Anthropic, Meta and OpenAI as operators of split crawlers.

Definition

Cloudflare's label for crawler operators that offer a training opt-out, an AI-summary opt-out, URL-level visibility, and an assurance that opting out of training does not affect search.

Sourced example

Cloudflare says Apple, Google and Microsoft meet the Accountable qualifications. Source, read 2026-11-04.

How it shows up here

Cloudflare applied the label on 2026-09-15 to Apple, Google and Microsoft as mixed-use crawlers, and to Amazon, Anthropic, Meta and OpenAI as operators of split crawlers.

Previous: Web Bot Auth. Next: Agentic browser. All 41 terms.

Sources

Last reviewed 2026-11-04