Agent Ready Crawlers

The field guide to every AI crawler and agent at the door, and the vendors who decide who gets in.

Mistral AI: 3 rows

In short

Mistral AI has 3 rows in the Index: MistralAI-User, MistralAI-Index and MistralAI-Training. They cover 3 purposes: live answer fetch, search index, training. 3 of them have a robots.txt token and 1 publish nothing a site can verify. The most refused is MistralAI-User, disallowed at the root by 7.7 percent of top-10,000 sites.

Mistral AI: 3 rows.

Operator Token Purpose Respects robots.txt Verification Block rate 2026-11-04 Profile
Mistral AI MistralAI-User Live answer fetch Yes IP list 7.7% Profile
Mistral AI MistralAI-Index Search index Yes IP list not measured Profile
Mistral AI MistralAI-Training Training Yes None published not measured Profile

Vendor profile: Mistral AI, with its products, standards, our probes and what it does not do.

Verification Ledger entry

Summary
IP lists for User and Index; none linked for Training.
IP lists
Reverse DNS
publishes nothing
Key directory
publishes nothing
Cloudflare
not checked
Visa and Mastercard
Visa TAP: no public operator-level registration found (checked 2026-11-04). Mastercard Agent Pay: no public operator-level registration found (checked 2026-11-04).

Block rates for Mistral AI tokens

TokenRefused, top 10,000NamedVia *All crawled
MistralAI-User7.7%3.8%3.9%5.5%

Based on 5,938 top-10,000 sites with a parsed robots.txt; crawl of 2026-11-04.

Sources

Last reviewed 2026-11-04