Agent Ready Crawlers

The field guide to every AI crawler and agent at the door, and the vendors who decide who gets in.

Glossary

BotBase

In short

Cloudflare's directory of known bots and agents, with an operator portal (launched 2026-08-28) for submissions, status and edits. Cloudflare opened BotBase for Operators on 2026-08-28, giving operators submission status, editing and a behaviour model. Example: Operators can now edit a submission when moving from an IP list to Web Bot Auth signing.

Definition

Cloudflare's directory of known bots and agents, with an operator portal (launched 2026-08-28) for submissions, status and edits.

Sourced example

Operators can now edit a submission when moving from an IP list to Web Bot Auth signing. Source, read 2026-11-04.

How it shows up here

Cloudflare opened BotBase for Operators on 2026-08-28, giving operators submission status, editing and a behaviour model.

Previous: Bot score. Next: Browsing agent. All 41 terms.

Sources

Last reviewed 2026-11-04