Agent Ready Crawlers

The field guide to every AI crawler and agent at the door, and the vendors who decide who gets in.

Training crawler from Mistral AI

MistralAI-Training

In short

MistralAI-Training is Mistral AI's training crawler. The token to write in robots.txt is MistralAI-Training. The operator publishes nothing a site can check. The crawl of 2026-11-04 did not measure MistralAI-Training. Collects content to train or tune a model. Refusing it is the training opt-out. MistralAI-Training: webmasters can disallow this user agent in robots.txt.

Operator
Mistral AI Vendor profile: Mistral AI
Purpose
Training All training rows. Collects content to train or tune a model. Refusing it is the training opt-out.
User-agent string
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Training/1.0; +https://docs.mistral.ai/robots)
robots.txt token
MistralAI-Training Matched case-insensitively (RFC 9309). The token and the user-agent string are different things.
Respects robots.txt

Yes, per operator

Mistral: webmasters can disallow this user agent in robots.txt. Source, read 2026-11-04.

Verification

Nothing published

The operator publishes no list, reverse DNS pattern or key directory a site owner can check. Documentation, read 2026-11-04.

IP ranges
Not published.
Rate behaviour
Not published.
Block rate

Not measured: the crawl checked 31 AI and search tokens, and MistralAI-Training is not one of them.

Documentation
docs.mistral.ai, read 2026-11-04.

Note. No IP list linked for the training crawler on Mistral's page (checked 2026-11-04).

Allow and refuse lines

To allow MistralAI-Training

User-agent: MistralAI-Training
Allow: /

To refuse MistralAI-Training

User-agent: MistralAI-Training
Disallow: /

Refusing or allowing in robots.txt states a preference. Enforcement of a refusal belongs in your WAF; see how to verify the identity above.

Mistral AI in the Verification Ledger

IP lists for User and Index; none linked for Training. All operators.

IP lists
Reverse DNS
publishes nothing
Key directory
publishes nothing
Cloudflare
not checked
Visa TAP registry
no public operator-level registration found (checked 2026-11-04)
Mastercard Agent Pay
no public operator-level registration found (checked 2026-11-04)

Other Mistral AI rows

Sources

Last reviewed 2026-11-04