---
title: "OpenAI crawlers and agents | Agent Ready Crawlers"
description: "OpenAI in the Crawler Index: 6 crawlers and agents with tokens, purposes, verification method and block rates, read 2026-11-04."
canonical: https://agentreadycrawlers.com/crawlers/operator/openai
site: "Agent Ready Crawlers"
last_updated: 2026-11-04
section: "Crawlers"
---

# OpenAI crawlers and agents | Agent Ready Crawlers

> OpenAI in the Crawler Index: 6 crawlers and agents with tokens, purposes, verification method and block rates, read 2026-11-04.

Source: https://agentreadycrawlers.com/crawlers/operator/openai
Site: Agent Ready Crawlers
Last reviewed: 2026-11-04

# OpenAI: 6 rows

In short

OpenAI has 6 rows in the Index: GPTBot, OAI-SearchBot, ChatGPT-User, OAI-AdsBot, ChatGPT agent and ChatGPT Atlas. They cover 5 purposes: training, search index, live answer fetch, other, task agent. 4 of them have a robots.txt token and 1 publish nothing a site can verify. The most refused is GPTBot, disallowed at the root by 18.5 percent of top-10,000 sites.

OpenAI: 6 rows.

| Operator | Token | Purpose | Respects robots.txt | Verification | Block rate 2026-11-04 | Profile |
| --- | --- | --- | --- | --- | --- | --- |
| OpenAI | GPTBot | Training | Yes | IP list | 18.5% | Profile |
| OpenAI | OAI-SearchBot | Search index | Yes | IP list | 7.7% | Profile |
| OpenAI | ChatGPT-User | Live answer fetch | May not apply | IP list | 9.7% | Profile |
| OpenAI | OAI-AdsBot | Other | No statement | IP list | not measured | Profile |
| OpenAI | ChatGPT agent (Cloud browser, formerly Operator) no token | Task agent | No statement | Web Bot Auth | no token | Profile |
| OpenAI | ChatGPT Atlas (browser agent mode) no token | Task agent | No docs | None published | no token | Profile |

Vendor profile: [OpenAI](https://agentreadycrawlers.com/vendors/openai/), with its products, standards, our probes and what it does not do.

## Verification Ledger entry

Summary

One IP JSON per crawler plus a Web Bot Auth key directory for the Cloud browser. The most complete set read.

IP lists

-   [openai.com/gptbot.json](https://openai.com/gptbot.json)
-   [openai.com/searchbot.json](https://openai.com/searchbot.json)
-   [openai.com/chatgpt-user.json](https://openai.com/chatgpt-user.json)
-   [openai.com/adsbot.json](https://openai.com/adsbot.json)

Reverse DNS

publishes nothing

Key directory

https://chatgpt.com/.well-known/http-message-signatures-directory

Cloudflare

GPTBot and ChatGPT agent listed Verified on Radar (read 2026-11-04); ChatGPT agent is a Cloudflare signed agent, detection ID 129220581

Visa and Mastercard

Visa TAP: no public operator-level registration found (checked 2026-11-04). Mastercard Agent Pay: no public operator-level registration found (checked 2026-11-04).

## Block rates for OpenAI tokens

| Token | Refused, top 10,000 | Named | Via * | All crawled |
| --- | --- | --- | --- | --- |
| GPTBot | 18.5% | 15.2% | 3.3% | 13.9% |
| ChatGPT-User | 9.7% | 6.3% | 3.3% | 6.9% |
| OAI-SearchBot | 7.7% | 4.4% | 3.3% | 5.4% |

Based on 5,938 top-10,000 sites with a parsed robots.txt; crawl of 2026-11-04.

## In the news

-   2026-10-27[OpenAI updates the ChatGPT-User IP list](https://agentreadycrawlers.com/news/2026-10-27-openai-updates-the-chatgpt-user-ip-list/)

## Sources

-   [Overview of OpenAI Crawlers](https://platform.openai.com/docs/bots) read 2026-11-04
-   [openai.com: gptbot (JSON)](https://openai.com/gptbot.json) read 2026-11-04
-   [openai.com: searchbot (JSON)](https://openai.com/searchbot.json) read 2026-11-04
-   [openai.com: chatgpt user (JSON)](https://openai.com/chatgpt-user.json) read 2026-11-04
-   [openai.com: adsbot (JSON)](https://openai.com/adsbot.json) read 2026-11-04
-   [ChatGPT Work's Cloud browser allowlisting](https://help.openai.com/en/articles/11845367-chatgpt-agent-allowlisting) read 2026-11-04
-   [chatgpt.com: http message signatures directory](https://chatgpt.com/.well-known/http-message-signatures-directory) read 2026-11-04

Last reviewed 2026-11-04