---
title: "Bot Preference Sync: definition | Agent Ready Crawlers"
description: "Bot Preference Sync: The Cloudflare feature that writes a zone's crawler preferences into the robots.txt it serves. Read 2026-11-04."
canonical: https://agentreadycrawlers.com/glossary/bot-preference-sync
site: "Agent Ready Crawlers"
last_updated: 2026-11-04
section: "Glossary"
---

# Bot Preference Sync: definition | Agent Ready Crawlers

> Bot Preference Sync: The Cloudflare feature that writes a zone's crawler preferences into the robots.txt it serves. Read 2026-11-04.

Source: https://agentreadycrawlers.com/glossary/bot-preference-sync
Site: Agent Ready Crawlers
Last reviewed: 2026-11-04

Glossary

# Bot Preference Sync

In short

The Cloudflare feature that writes a zone's crawler preferences into the robots.txt it serves, replacing Managed Robots.txt from 2026-09-15. It replaced Managed Robots.txt on 2026-09-15, so a Cloudflare-served robots.txt may differ from the file in your repository. Example: Customers who enabled Managed Robots.txt migrate to Bot Preference Sync, per Cloudflare.

## Definition

The Cloudflare feature that writes a zone's crawler preferences into the robots.txt it serves, replacing Managed Robots.txt from 2026-09-15.

## Sourced example

Customers who enabled Managed Robots.txt migrate to Bot Preference Sync, per Cloudflare. [Source](https://blog.cloudflare.com/accountable-mixed-use-ai-crawlers/), read 2026-11-04.

## How it shows up here

It replaced Managed Robots.txt on 2026-09-15, so a Cloudflare-served robots.txt may differ from the file in your repository.

-   [Cloudflare adds Disallow AI Training and the Accountable label](https://agentreadycrawlers.com/news/2026-09-15-cloudflare-adds-disallow-ai-training-and-the-accountable-lab/)
-   [Cloudflare profile](https://agentreadycrawlers.com/vendors/cloudflare/)

Previous: [Bot paywall](https://agentreadycrawlers.com/glossary/bot-paywall/). Next: [Bot score](https://agentreadycrawlers.com/glossary/bot-score/). [All 41 terms](https://agentreadycrawlers.com/glossary/).

## Sources

-   [Have it both ways: stay discoverable in search while disallowing AI training](https://blog.cloudflare.com/accountable-mixed-use-ai-crawlers/) read 2026-11-04

Last reviewed 2026-11-04