Agent Ready Crawlers

The field guide to every AI crawler and agent at the door, and the vendors who decide who gets in.

Search index crawler from Mistral AI

MistralAI-Index

In short

MistralAI-Index is Mistral AI's search index crawler. The token to write in robots.txt is MistralAI-Index. Check a visitor against the operator's published IP list. The crawl of 2026-11-04 did not measure MistralAI-Index. Its user-agent entry: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Index/1.0; +https://docs.mistral.ai/robots). On robots.txt, indexing only; content is not used for generative AI training of any kind.

Operator
Mistral AI Vendor profile: Mistral AI
Purpose
Search index All search index rows. Builds a search index that sends visitors back. Refusing it removes pages from that product.
User-agent string
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Index/1.0; +https://docs.mistral.ai/robots)
robots.txt token
MistralAI-Index Matched case-insensitively (RFC 9309). The token and the user-agent string are different things.
Respects robots.txt

Yes, per operator

Mistral: indexing only; content is not used for generative AI training of any kind. Source, read 2026-11-04.

Verification

Published IP list (JSON)

Match the source address of a request against the operator's published list. Documentation, read 2026-11-04.

IP ranges
mistral.ai/mistralai-index-ips.json
Rate behaviour
Not published.
Block rate

Not measured: the crawl checked 31 AI and search tokens, and MistralAI-Index is not one of them.

Documentation
docs.mistral.ai, read 2026-11-04.

Note. Indexes for Mistral search.

Allow and refuse lines

To allow MistralAI-Index

User-agent: MistralAI-Index
Allow: /

To refuse MistralAI-Index

User-agent: MistralAI-Index
Disallow: /

Refusing or allowing in robots.txt states a preference. Enforcement of a refusal belongs in your WAF; see how to verify the identity above.

Mistral AI in the Verification Ledger

IP lists for User and Index; none linked for Training. All operators.

IP lists
Reverse DNS
publishes nothing
Key directory
publishes nothing
Cloudflare
not checked
Visa TAP registry
no public operator-level registration found (checked 2026-11-04)
Mastercard Agent Pay
no public operator-level registration found (checked 2026-11-04)

Other Mistral AI rows

Sources

Last reviewed 2026-11-04