--- title: "ChatGPT-User: user agent, token, block rate | Agent Ready Crawlers" description: "ChatGPT-User from OpenAI: exact user-agent string, robots.txt token ChatGPT-User, live answer fetch purpose and how to verify it. 9.7% of top sites block it." canonical: https://agentreadycrawlers.com/crawlers/chatgpt-user site: "Agent Ready Crawlers" last_updated: 2026-11-04 section: "Crawlers" --- # ChatGPT-User: user agent, token, block rate | Agent Ready Crawlers > ChatGPT-User from OpenAI: exact user-agent string, robots.txt token ChatGPT-User, live answer fetch purpose and how to verify it. 9.7% of top sites block it. Source: https://agentreadycrawlers.com/crawlers/chatgpt-user Site: Agent Ready Crawlers Last reviewed: 2026-11-04 Live answer fetcher from OpenAI # ChatGPT-User In short ChatGPT-User is OpenAI's live answer fetcher. The token to write in robots.txt is ChatGPT-User. Check a visitor against the operator's published IP list. 9.7 percent of 5,938 top-10,000 sites with a parsed robots.txt disallow it at the root (crawl of 2026-11-04). ChatGPT-User: because these actions are initiated by a user, robots.txt rules may not apply. Operator [OpenAI](https://agentreadycrawlers.com/crawlers/operator/openai/) Vendor profile: [OpenAI](https://agentreadycrawlers.com/vendors/openai/) Purpose Live answer fetch [All live answer fetch rows](https://agentreadycrawlers.com/crawlers/purpose/live-answer-fetch/). Fetches a page because a person asked an assistant about it, one request at a time. User-agent string `Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot` robots.txt token `ChatGPT-User` Matched case-insensitively (RFC 9309). The token and the user-agent string are different things. Respects robots.txt May not apply (user-triggered) OpenAI: because these actions are initiated by a user, robots.txt rules may not apply. ChatGPT-User is not used to decide search inclusion. [Source](https://platform.openai.com/docs/bots), read 2026-11-04. Verification Published IP list (JSON) Match the source address of a request against the operator's published list. [Documentation](https://openai.com/chatgpt-user.json), read 2026-11-04. IP ranges [openai.com/chatgpt-user.json](https://openai.com/chatgpt-user.json) Rate behaviour Not used for automatic crawling, per OpenAI. chatgpt-user.json creationTime read: 2026-10-27. Block rate **9.7%** of 5,938 top-10,000 sites with a parsed robots.txt disallow `ChatGPT-User` at the root (574 sites). 6.3% name it; 3.3% refuse it only through a \* group. Rank 20 of 31 tokens measured. Across all 8,624 parsed robots.txt files in the crawl: 6.9% (4.5% named). Crawl of 2026-11-04; [report](https://agentreadycrawlers.com/block-rates/). Documentation [platform.openai.com](https://platform.openai.com/docs/bots), read 2026-11-04. Note. Also used for GPT Actions and Custom GPT fetches. Use OAI-SearchBot, not ChatGPT-User, to manage search opt-outs. ## Allow and refuse lines ### To allow ChatGPT-User User-agent: ChatGPT-User Allow: / ### To refuse ChatGPT-User User-agent: ChatGPT-User Disallow: / Refusing or allowing in robots.txt states a preference. For this row the operator or its documentation says robots.txt may not govern the fetch, so enforcement belongs in your WAF. ## OpenAI in the Verification Ledger One IP JSON per crawler plus a Web Bot Auth key directory for the Cloud browser. The most complete set read. [All operators](https://agentreadycrawlers.com/verification/). IP lists - [openai.com/gptbot.json](https://openai.com/gptbot.json) - [openai.com/searchbot.json](https://openai.com/searchbot.json) - [openai.com/chatgpt-user.json](https://openai.com/chatgpt-user.json) - [openai.com/adsbot.json](https://openai.com/adsbot.json) Reverse DNS publishes nothing Key directory https://chatgpt.com/.well-known/http-message-signatures-directory Cloudflare GPTBot and ChatGPT agent listed Verified on Radar (read 2026-11-04); ChatGPT agent is a Cloudflare signed agent, detection ID 129220581 Visa TAP registry no public operator-level registration found (checked 2026-11-04) Mastercard Agent Pay no public operator-level registration found (checked 2026-11-04) ## In the news - 2026-10-27[OpenAI updates the ChatGPT-User IP list](https://agentreadycrawlers.com/news/2026-10-27-openai-updates-the-chatgpt-user-ip-list/) ## Other OpenAI rows - [GPTBot](https://agentreadycrawlers.com/crawlers/gptbot/) Training token GPTBot - [OAI-SearchBot](https://agentreadycrawlers.com/crawlers/oai-searchbot/) Search index token OAI-SearchBot - [OAI-AdsBot](https://agentreadycrawlers.com/crawlers/oai-adsbot/) Other token OAI-AdsBot - [ChatGPT agent (Cloud browser, formerly Operator)](https://agentreadycrawlers.com/crawlers/chatgpt-agent/) Task agent no token - [ChatGPT Atlas (browser agent mode)](https://agentreadycrawlers.com/crawlers/chatgpt-atlas/) Task agent no token ## Sources - [Overview of OpenAI Crawlers](https://platform.openai.com/docs/bots) read 2026-11-04 - [openai.com: chatgpt user (JSON)](https://openai.com/chatgpt-user.json) read 2026-11-04 Last reviewed 2026-11-04