Agent Ready Crawlers

The field guide to every AI crawler and agent at the door, and the vendors who decide who gets in.

Search index crawler from Amazon

Amzn-SearchBot

In short

Amzn-SearchBot is Amazon's search index crawler. Check a visitor against the operator's published IP list. The crawl of 2026-11-04 did not measure Amzn-SearchBot. Eligibility for Alexa and other Amazon search experiences. Amzn-SearchBot: if robots.txt does not mention Amzn-SearchBot but allows other search bots, it follows the directives given to other search bots.

Operator
Amazon Vendor profile: Amazon
Purpose
Search index All search index rows. Builds a search index that sends visitors back. Refusing it removes pages from that product.
User-agent string
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amzn-SearchBot/0.1) Chrome/W.X.Y.Z Safari/537.36
robots.txt token
Amzn-SearchBot Matched case-insensitively (RFC 9309). The token and the user-agent string are different things.
Respects robots.txt

Yes, per operator

Amazon: if robots.txt does not mention Amzn-SearchBot but allows other search bots, it follows the directives given to other search bots. Not used for training. Source, read 2026-11-04.

Verification

Published IP list (JSON)

Match the source address of a request against the operator's published list. Documentation, read 2026-11-04.

IP ranges
developer.amazon.com/amazonbot/searchbot-ip-addresses/
Rate behaviour
Does not support Crawl-delay.
Block rate

Not measured: the crawl checked 31 AI and search tokens, and Amzn-SearchBot is not one of them.

Documentation
developer.amazon.com, read 2026-11-04.

Note. Eligibility for Alexa and other Amazon search experiences.

Allow and refuse lines

To allow Amzn-SearchBot

User-agent: Amzn-SearchBot
Allow: /

To refuse Amzn-SearchBot

User-agent: Amzn-SearchBot
Disallow: /

Refusing or allowing in robots.txt states a preference. Enforcement of a refusal belongs in your WAF; see how to verify the identity above.

Amazon in the Verification Ledger

Three IP lists on HTML pages with JSON bodies; nothing for Buy for Me or Rufus. All operators.

IP lists
Reverse DNS
publishes nothing
Key directory
publishes nothing
Cloudflare
not checked
Visa TAP registry
no public operator-level registration found (checked 2026-11-04)
Mastercard Agent Pay
no public operator-level registration found (checked 2026-11-04)

Other Amazon rows

Sources

Last reviewed 2026-11-04