Agent Ready Crawlers

The field guide to every AI crawler and agent at the door, and the vendors who decide who gets in.

Bot from OpenAI

OAI-AdsBot

In short

OAI-AdsBot is OpenAI's bot, filed under Other. The token to write in robots.txt is OAI-AdsBot. Check a visitor against the operator's published IP list. The crawl of 2026-11-04 did not measure OAI-AdsBot. OpenAI: OAI-AdsBot only visits pages submitted as ads on ChatGPT; OpenAI does not state robots.txt handling for it.

Operator
OpenAI Vendor profile: OpenAI
Purpose
Other All other rows. Link previews, ad checks, dataset crawls, SEO tools and legacy tokens that fit none of the five purposes.
User-agent string
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; OAI-AdsBot/1.0; +https://openai.com/adsbot
robots.txt token
OAI-AdsBot Matched case-insensitively (RFC 9309). The token and the user-agent string are different things.
Respects robots.txt

No statement

OpenAI: OAI-AdsBot only visits pages submitted as ads on ChatGPT; OpenAI does not state robots.txt handling for it. Source, read 2026-11-04.

Verification

Published IP list (JSON)

Match the source address of a request against the operator's published list. Documentation, read 2026-11-04.

IP ranges
openai.com/adsbot.json
Rate behaviour
Visits only landing pages submitted as ads, per OpenAI.
Block rate

Not measured: the crawl checked 31 AI and search tokens, and OAI-AdsBot is not one of them.

Documentation
platform.openai.com, read 2026-11-04.

Note. Data collected by OAI-AdsBot is not used to train foundation models, per OpenAI. Blocking it affects ad review, not search or training.

Allow and refuse lines

To allow OAI-AdsBot

User-agent: OAI-AdsBot
Allow: /

To refuse OAI-AdsBot

User-agent: OAI-AdsBot
Disallow: /

Refusing or allowing in robots.txt states a preference. Enforcement of a refusal belongs in your WAF; see how to verify the identity above.

OpenAI in the Verification Ledger

One IP JSON per crawler plus a Web Bot Auth key directory for the Cloud browser. The most complete set read. All operators.

IP lists
Reverse DNS
publishes nothing
Key directory
https://chatgpt.com/.well-known/http-message-signatures-directory
Cloudflare
GPTBot and ChatGPT agent listed Verified on Radar (read 2026-11-04); ChatGPT agent is a Cloudflare signed agent, detection ID 129220581
Visa TAP registry
no public operator-level registration found (checked 2026-11-04)
Mastercard Agent Pay
no public operator-level registration found (checked 2026-11-04)

Other OpenAI rows

Sources

Last reviewed 2026-11-04