Agent Ready Crawlers

The field guide to every AI crawler and agent at the door, and the vendors who decide who gets in.

Head-to-head

Imperva vs Cloudflare

In short

Imperva's verified-trust control for AI agents exists only in Imperva for Google Cloud in Controlled Availability (2026-05-04); Cloudflare's verified bots and signed agents work on every zone. On verifies agents the rubric grades Imperva partial and Cloudflare yes, and on per-purpose policy the rubric grades Imperva not published and Cloudflare yes. For publisher operations: Imperva lists no AI charging.

The sourced difference

Imperva's verified-trust control for AI agents exists only in Imperva for Google Cloud in Controlled Availability (2026-05-04); Cloudflare's verified bots and signed agents work on every zone. Source, read 2026-11-04.

Side by side

QuestionImpervaCloudflare
Tells a verified agent from a spoof Partial
verified trust for verified AI agents in Imperva for Google Cloud (controlled availability); no Web Bot Auth support found (checked 2026-11-04)		 Yes
Web Bot Auth signatures, IP validation, verified bot and signed agent directory (BotBase)
Per-purpose policy (train, search, answer, act) Not published
per-purpose AI crawler policy (checked 2026-11-04)		 Yes
separate Search, Training and Agent controls on all plans, plus Disallow AI Training since 2026-09-15
Charging for access Not published
support (checked 2026-11-04)		 Partial
Pay per crawl with HTTP 402, Cloudflare as Merchant of Record, private beta
Lets signed commerce agents through Not published
Visa TAP or Mastercard Agent Pay support (checked 2026-11-04)		 Partial
Visa TAP and Mastercard Agent Pay built on Web Bot Auth, managed rulesets announced Oct 2025; current rule name not confirmed in docs (checked 2026-11-04)
Cost no public price; sales-led free tier covers AI Crawl Control; Pro from USD 20/month; Bot Management and BotBase are Enterprise and sales-led
Reporting Yes
customizable dashboards and reports		 Yes
AI Crawl Control analytics on crawler activity, request patterns and robots.txt compliance
Where it runs edge or cloud: Imperva cloud WAF stack, Imperva for AWS and Imperva for Google Cloud edge: enforced on Cloudflare's reverse proxy, no app code needed
Points, rank3 of 10, rank 11 (tied)8 of 10, rank 1 (tied)
Price read 2026-11-04no public price; sales-led (checked 2026-11-04)AI Crawl Control and the Search, Training and Agent controls are on all plans including Free (USD 0). Pro USD 20/month billed annually or USD 25 monthly; Business USD 200/month annually or USD 250 monthly; Enterprise Bot Management and BotBase are sales-led. Pay per crawl prices are set by the site owner (private beta).

Verdicts by reader

Platform engineer
Imperva ABP is a sales-led bundle; Cloudflare starts free.
Security engineer
No Web Bot Auth support found for Imperva (checked 2026-11-04).
Publisher operations
Imperva lists no AI charging.

What each does not do

Imperva

  • No Web Bot Auth or signed-agent verification found on Imperva or Thales pages read (checked 2026-11-04).
  • No AI crawler monetization or pay-per-crawl feature found (ABP page).
  • Agent verified-trust controls are limited to Imperva for Google Cloud and are in Controlled Availability (Thales blog, 2026-05-04).

Cloudflare

  • BotBase does not block traffic itself; mitigation needs Security rules or AI traffic options (BotBase docs, updated 2026-10-08).
  • Disallow AI Training cannot pass a no-training preference to Bing until Microsoft ships robots.txt support, targeted early 2027 (Cloudflare blog, 2026-09-15).
  • Web Bot Auth verification does no nonce validation today; Cloudflare relies on short expires values (Web Bot Auth docs).
  • Pay per crawl is not self-serve: the docs (updated 2026-07-28) tell site owners to reach out to Cloudflare to join the beta.

More: alternatives to Imperva, alternatives to Cloudflare.

Sources

Last reviewed 2026-11-04