Agent Ready Crawlers

The field guide to every AI crawler and agent at the door, and the vendors who decide who gets in.

Bot from Google

GoogleOther

In short

GoogleOther is Google's bot, filed under Other. The token to write in robots.txt is GoogleOther. Verify it by reverse DNS, then a forward lookup. The crawl of 2026-11-04 did not measure GoogleOther. Blocking GoogleOther does not affect any specific Google product, per Google. GoogleOther obeys robots.txt when crawling automatically, per Google.

Operator
Google Vendor profile: Google
Purpose
Other All other rows. Link previews, ad checks, dataset crawls, SEO tools and legacy tokens that fit none of the five purposes.
User-agent string
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GoogleOther) Chrome/W.X.Y.Z Safari/537.36
robots.txt token
GoogleOther Matched case-insensitively (RFC 9309). The token and the user-agent string are different things.
Respects robots.txt

Yes, per operator

Common crawler: obeys robots.txt when crawling automatically, per Google. Source, read 2026-11-04.

Verification

Reverse DNS

Reverse-resolve the source address, then forward-resolve the name and require the same address. Documentation, read 2026-11-04.

IP ranges
developers.google.com/static/search/apis/ipranges/googlebot.json
Rate behaviour
Not product specific; used for one-off crawls such as internal research and development.
Block rate

Not measured: the crawl checked 31 AI and search tokens, and GoogleOther is not one of them.

Documentation
developers.google.com, read 2026-11-04.

Note. Blocking GoogleOther does not affect any specific Google product, per Google.

Allow and refuse lines

To allow GoogleOther

User-agent: GoogleOther
Allow: /

To refuse GoogleOther

User-agent: GoogleOther
Disallow: /

Refusing or allowing in robots.txt states a preference. Enforcement of a refusal belongs in your WAF; see how to verify the identity above.

Google in the Verification Ledger

Five IP lists, reverse DNS for every class, and an experimental key directory for Google-Agent. Nothing for auto browse in the user's Chrome. All operators.

IP lists
Reverse DNS
crawl-*.googlebot.com, geo-crawl-*.geo.googlebot.com, rate-limited-proxy-*.google.com, *.gae.googleusercontent.com, google-proxy-*.google.com
Key directory
https://agent.bot.goog/.well-known/http-message-signatures-directory (Google-Agent, subset of requests, experimental)
Cloudflare
not checked
Visa TAP registry
no public operator-level registration found (checked 2026-11-04)
Mastercard Agent Pay
no public operator-level registration found (checked 2026-11-04)

Other Google rows

Sources

Last reviewed 2026-11-04