Glossary
Spoofed crawler
In short
A request that copies a known crawler's user agent to get treatment meant for the real bot. The Index pairs every row with the way to check it: 17 by IP list, 9 by reverse DNS, 8 by signature. Example: HUMAN found 5.7 percent of traffic presenting an AI crawler or scraper user agent was spoofed.
Definition
A request that copies a known crawler's user agent to get treatment meant for the real bot.
Sourced example
HUMAN found 5.7 percent of traffic presenting an AI crawler or scraper user agent was spoofed. Source, read 2026-11-04.
How it shows up here
The Index pairs every row with the way to check it: 17 by IP list, 9 by reverse DNS, 8 by signature.
Previous: Signed agent. Next: Training crawler. All 41 terms.
Sources
Last reviewed 2026-11-04