Search index crawler from DuckDuckGo
DuckDuckBot
In short
DuckDuckBot is DuckDuckGo's search index crawler. The token to write in robots.txt is DuckDuckBot. Check a visitor against the operator's published IP list. The crawl of 2026-11-04 did not measure DuckDuckBot. Its user-agent entry: DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html). Builds a search index that sends visitors back. Refusing it removes pages from that product. On robots.txt, DuckDuckGo: DuckDuckBot respects robotstxt.org.
- Operator
- DuckDuckGo
- Purpose
- Search index All search index rows. Builds a search index that sends visitors back. Refusing it removes pages from that product.
- User-agent string
DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html)- robots.txt token
DuckDuckBot- Respects robots.txt
Yes, per operator
DuckDuckGo: DuckDuckBot respects robotstxt.org. Source, read 2026-11-04.
- Verification
Published IP list (JSON)
Match the source address of a request against the operator's published list. Documentation, read 2026-11-04.
- IP ranges
- duckduckgo.com/duckduckbot.json
- Rate behaviour
- Not published.
- Block rate
-
Not measured: the crawl checked 31 AI and search tokens, and
DuckDuckBotis not one of them. - Documentation
- duckduckgo.com, read 2026-11-04.
Note. Search crawler, separate from DuckAssistBot.
Allow and refuse lines
To allow DuckDuckBot
User-agent: DuckDuckBot Allow: /
To refuse DuckDuckBot
User-agent: DuckDuckBot Disallow: /
Refusing or allowing in robots.txt states a preference. Enforcement of a refusal belongs in your WAF; see how to verify the identity above.
DuckDuckGo in the Verification Ledger
Two IP lists. All operators.
- IP lists
- Reverse DNS
- publishes nothing
- Key directory
- publishes nothing
- Cloudflare
- not checked
- Visa TAP registry
- no public operator-level registration found (checked 2026-11-04)
- Mastercard Agent Pay
- no public operator-level registration found (checked 2026-11-04)
Other DuckDuckGo rows
- DuckAssistBot Live answer fetch
Sources
Last reviewed 2026-11-04