---
title: "Disallow AI Training: definition | Agent Ready Crawlers"
description: "Disallow AI Training: a Cloudflare setting, launched 2026-09-15, that publishes a no-training preference in robots.txt and keeps search crawlers allowed."
canonical: https://agentreadycrawlers.com/glossary/disallow-ai-training
site: "Agent Ready Crawlers"
last_updated: 2026-11-04
section: "Glossary"
---

# Disallow AI Training: definition | Agent Ready Crawlers

> Disallow AI Training: a Cloudflare setting, launched 2026-09-15, that publishes a no-training preference in robots.txt and keeps search crawlers allowed.

Source: https://agentreadycrawlers.com/glossary/disallow-ai-training
Site: Agent Ready Crawlers
Last reviewed: 2026-11-04

Glossary

# Disallow AI Training

In short

A Cloudflare Training-control setting launched 2026-09-15 that publishes a no-training preference in robots.txt, keeps Accountable mixed-use crawlers for search and blocks other training crawlers. It is one of the Cloudflare controls dated 2026-09-15 and the reason Block now stops Googlebot, Bingbot and Applebot while Disallow AI Training does not.

## Definition

A Cloudflare Training-control setting launched 2026-09-15 that publishes a no-training preference in robots.txt, keeps Accountable mixed-use crawlers for search and blocks other training crawlers.

## Sourced example

Under Disallow AI Training, training-only crawlers from Amazon, Anthropic, Meta and OpenAI are blocked. [Source](https://blog.cloudflare.com/accountable-mixed-use-ai-crawlers/), read 2026-11-04.

## How it shows up here

It is one of the Cloudflare controls dated 2026-09-15 and the reason Block now stops Googlebot, Bingbot and Applebot while Disallow AI Training does not.

-   [Cloudflare adds Disallow AI Training and the Accountable label](https://agentreadycrawlers.com/news/2026-09-15-cloudflare-adds-disallow-ai-training-and-the-accountable-lab/)
-   [Allow search, refuse training](https://agentreadycrawlers.com/guides/allow-search-refuse-training/)

Previous: [crawler-price header](https://agentreadycrawlers.com/glossary/crawler-price-header/). Next: [Google-Extended](https://agentreadycrawlers.com/glossary/google-extended/). [All 41 terms](https://agentreadycrawlers.com/glossary/).

## Sources

-   [Have it both ways: stay discoverable in search while disallowing AI training](https://blog.cloudflare.com/accountable-mixed-use-ai-crawlers/) read 2026-11-04

Last reviewed 2026-11-04