---
title: "PerplexityBot: user agent, token, block rate | Agent Ready Crawlers"
description: "PerplexityBot from Perplexity: exact user-agent string, robots.txt token PerplexityBot, search index purpose and how to verify it. Read 2026-11-04."
canonical: https://agentreadycrawlers.com/crawlers/perplexitybot
site: "Agent Ready Crawlers"
last_updated: 2026-11-04
section: "Crawlers"
---

# PerplexityBot: user agent, token, block rate | Agent Ready Crawlers

> PerplexityBot from Perplexity: exact user-agent string, robots.txt token PerplexityBot, search index purpose and how to verify it. Read 2026-11-04.

Source: https://agentreadycrawlers.com/crawlers/perplexitybot
Site: Agent Ready Crawlers
Last reviewed: 2026-11-04

Search index crawler from Perplexity

# PerplexityBot

In short

PerplexityBot is Perplexity's search index crawler. The token to write in robots.txt is PerplexityBot. Check a visitor against the operator's published IP list. Changes may take up to 24 hours to reflect, per Perplexity. Perplexity recommends allowing PerplexityBot in robots.txt to appear in results and says it is not used to crawl content for AI foundation models.

Operator

[Perplexity](https://agentreadycrawlers.com/crawlers/operator/perplexity/) Vendor profile: [Perplexity](https://agentreadycrawlers.com/vendors/perplexity/)

Purpose

Search index [All search index rows](https://agentreadycrawlers.com/crawlers/purpose/search-index/). Builds a search index that sends visitors back. Refusing it removes pages from that product.

User-agent string

`Mozilla/5.0 (compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)`

robots.txt token

`PerplexityBot` Matched case-insensitively (RFC 9309). The token and the user-agent string are different things.

Respects robots.txt

Yes, per operator

Perplexity recommends allowing PerplexityBot in robots.txt to appear in results and says it is not used to crawl content for AI foundation models. [Source](https://docs.perplexity.ai/guides/bots), read 2026-11-04.

Verification

Published IP list (JSON)

Match the source address of a request against the operator's published list. [Documentation](https://www.perplexity.ai/perplexitybot.json), read 2026-11-04.

IP ranges

[perplexity.ai/perplexitybot.json](https://www.perplexity.ai/perplexitybot.json)

Rate behaviour

Changes may take up to 24 hours to reflect, per Perplexity.

Vendor rule names

-   **Cloudflare:** Custom rule: (http.user\_agent contains "PerplexityBot" and ip.src in {ranges}), action Skip; Perplexity notes Bot Fight Mode cannot be skipped
-   **AWS WAF:** IP set plus User-Agent string match, action Allow

Block rate

**11.2%** of 5,938 top-10,000 sites with a parsed robots.txt disallow `PerplexityBot` at the root (667 sites). 7.9% name it; 3.4% refuse it only through a \* group. Rank 15 of 31 tokens measured.

Across all 8,624 parsed robots.txt files in the crawl: 7.9% (5.5% named). Crawl of 2026-11-04; [report](https://agentreadycrawlers.com/block-rates/).

Documentation

[docs.perplexity.ai](https://docs.perplexity.ai/guides/bots), read 2026-11-04.

Note. Perplexity publishes WAF recipes for Cloudflare and AWS that pair the user agent with its IP list.

## Allow and refuse lines

### To allow PerplexityBot

User-agent: PerplexityBot
Allow: /

### To refuse PerplexityBot

User-agent: PerplexityBot
Disallow: /

Refusing or allowing in robots.txt states a preference. Enforcement of a refusal belongs in your WAF; see how to verify the identity above.

## Perplexity in the Verification Ledger

Two IP lists and WAF recipes; no key directory (404 at www.perplexity.ai, 2026-11-04); nothing for Comet. [All operators](https://agentreadycrawlers.com/verification/).

IP lists

-   [www.perplexity.ai/perplexitybot.json](https://www.perplexity.ai/perplexitybot.json)
-   [www.perplexity.ai/perplexity-user.json](https://www.perplexity.ai/perplexity-user.json)

Reverse DNS

publishes nothing

Key directory

publishes nothing

Cloudflare

not checked

Visa TAP registry

no public operator-level registration found (checked 2026-11-04)

Mastercard Agent Pay

no public operator-level registration found (checked 2026-11-04)

## Other Perplexity rows

-   [Perplexity-User](https://agentreadycrawlers.com/crawlers/perplexity-user/) Live answer fetch token Perplexity-User
-   [Comet (browser assistant)](https://agentreadycrawlers.com/crawlers/perplexity-comet/) Task agent no token
-   [Perplexity Computer](https://agentreadycrawlers.com/crawlers/perplexity-computer/) Task agent no token

## Sources

-   [Perplexity Crawlers](https://docs.perplexity.ai/guides/bots) read 2026-11-04
-   [perplexity.ai: perplexitybot (JSON)](https://www.perplexity.ai/perplexitybot.json) read 2026-11-04

Last reviewed 2026-11-04