Glossary
Disallow AI Training
In short
A Cloudflare Training-control setting launched 2026-09-15 that publishes a no-training preference in robots.txt, keeps Accountable mixed-use crawlers for search and blocks other training crawlers. It is one of the Cloudflare controls dated 2026-09-15 and the reason Block now stops Googlebot, Bingbot and Applebot while Disallow AI Training does not.
Definition
A Cloudflare Training-control setting launched 2026-09-15 that publishes a no-training preference in robots.txt, keeps Accountable mixed-use crawlers for search and blocks other training crawlers.
Sourced example
Under Disallow AI Training, training-only crawlers from Amazon, Anthropic, Meta and OpenAI are blocked. Source, read 2026-11-04.
How it shows up here
It is one of the Cloudflare controls dated 2026-09-15 and the reason Block now stops Googlebot, Bingbot and Applebot while Disallow AI Training does not.
Previous: crawler-price header. Next: Google-Extended. All 41 terms.
Sources
Last reviewed 2026-11-04