Agent Ready Crawlers

The field guide to every AI crawler and agent at the door, and the vendors who decide who gets in.

Glossary

AIPREF training signal

In short

An IETF AI Preferences vocabulary for usage preferences. Google says it intends to read the training preference written as a user-agent line, __usage_ai-training, in early 2027. The robots.txt builder on this site does not write it. Related: What Content-Signals changes and Google-Extended profile.

Definition

An IETF AI Preferences vocabulary for usage preferences. Google says it intends to read the training preference written as a user-agent line, __usage_ai-training, in early 2027.

Sourced example

twitter.com's robots.txt already names __usage_ai-training (shared crawl, 2026-11-04); Google plans support in early 2027. Source, read 2026-11-04.

How it shows up here

The robots.txt builder on this site does not write it.

Previous: ai-input. Next: Applebot-Extended. All 41 terms.

Sources

Last reviewed 2026-11-04