Agent Ready Crawlers

The field guide to every AI crawler and agent at the door, and the vendors who decide who gets in.

Vendor, ranked 1 (tied) of 15

AWS WAF Bot Control

In short

AWS WAF Bot Control is Amazon's bot filter inside its web application firewall: it grades yes on agent verification, per-purpose policy, charging, through an x402 response, and reporting, for 8 of 10 points, with commerce agents not published. Pricing combines a flat monthly charge for each web ACL with a fee per million requests once a free allowance is used.

Managed rule group in AWS WAF that labels and blocks bots, verifies AI agents with Web Bot Auth, and since June 2026 can charge AI bots per request with HTTP 402 on CloudFront. Vendor description of itself, checked against its documents on 2026-11-04.

Alternatives to AWS WAF Bot Control ยท aws.amazon.com

Type
Bot management
Operator
Amazon
Homepage
aws.amazon.com
Last read
2026-11-05

The rubric, with evidence

QuestionGradeWhat the vendor documentsEvidence
Tells a verified agent from a spoof Yes Web Bot Auth (rule set Version_4.0+), verified self-identifying bots Bot Control docs section on Web Bot Authentication. Source, read 2026-11-04.
Per-purpose policy (train, search, answer, act) Yes rules on bot category and name labels; prices can differ by bot identity and verification status Monetize action uses Bot Control labels for pricing. Source, read 2026-11-04.
Charging for access Yes HTTP 402 x402 monetization on CloudFront, Coinbase x402 settlement in stablecoins What's new post 2026-06-15. Source, read 2026-11-04.
Lets signed commerce agents through Not published Visa TAP or Mastercard Agent Pay support (checked 2026-11-04) Not mentioned in Bot Control docs or announcements read. Source, read 2026-11-04.
Cost Not graded published: USD 10/month per web ACL plus USD 1 or USD 10 per million requests after free allowance WAF pricing page. Source, read 2026-11-04.
Reporting Yes Bot Control console dashboard, AI activity dashboard, CloudWatch metrics and logs Bot Control docs and Feb 2026 announcement. Source, read 2026-11-04.
Where it runs Not graded edge or regional: CloudFront edge and regional resources such as load balancers and API Gateway Web Bot Auth applies to CloudFront and Regional resources. Source, read 2026-11-04.

Cost

Bot Control USD 10/month per web ACL. Common level: first 10M requests/month free, then USD 1.00 per million. Targeted level: first 1M requests/month free, then USD 10.00 per million. Standard AWS WAF web ACL and rule charges also apply; AI traffic monetization has no extra charge. Source, read 2026-11-04.

What AWS WAF Bot Control does not do

Documented facts

Features are as the vendor documents them; we have not tested them. A claim a vendor makes about itself is marked as a vendor claim.

Compared with

What AWS WAF Bot Control does for this layer

From the vendor's own pages

AWS WAF Bot Control records each Web Bot Auth check as a label: web_bot_auth:verified, web_bot_auth:invalid, web_bot_auth:expired or web_bot_auth:unknown_bot. (docs.aws.amazon.com) When the web_bot_auth:verified label is present, Bot Control's category rules and its TGT_TokenAbsent rule do not match, so verified signers pass. (docs.aws.amazon.com) Bot Control adds a bot:account label holding an opaque hash of the AWS account that owns an AgentCore agent, so rules can allow, block or rate-limit agents per account without exposing account IDs. (docs.aws.amazon.com) Bot Control treats bots labelled bot:user_triggered:verified, which end users may invoke directly, like unverified bots. (docs.aws.amazon.com)

Bot Control decides whether a bot is verified from the request's origin IP and cannot be set to read a forwarded IP header instead. (docs.aws.amazon.com) Amazon Bedrock AgentCore Browser's Web Bot Auth signing is in Preview and, when enabled, adds Signature, Signature-Agent and Signature-Input headers to every request. (docs.aws.amazon.com) AWS says AgentCore registers with bot control vendors such as Cloudflare and reCAPTCHA and gives them public keys for verification. (docs.aws.amazon.com) AWS's AgentCore guide warns that not every website recognises signed agent traffic and that domain owners may still block, monitor or rate-limit it. (docs.aws.amazon.com)

Products and plans

ProductWhat it doesPrice modelFromAs of
AWS WAF Bot Control Managed rule group with Common and Targeted levels, bot labels, Web Bot Auth verification and the Monetize action. per web ACL plus per request Common level includes 10M requests a month free; Targeted includes 1M; AI traffic monetization has no extra charge. USD 10 2026-11-05
Amazon Bedrock AgentCore Browser Hosted browser for agents that can sign requests with Web Bot Auth (Preview). No price recorded

Standards

StandardStatusEvidence
Web Bot Auth Supports Bot Control Version_4.0 or later verifies Web Bot Auth and labels the result. (docs.aws.amazon.com)
Published IP list Supports Bot Control uses the request origin IP to verify bots. (docs.aws.amazon.com)
Reverse DNS check No statement The rule group page read 2026-11-05 does not name reverse DNS.
Visa Trusted Agent Protocol No statement No statement in the AWS WAF docs read 2026-11-05.
Mastercard Agent Pay No statement No statement in the AWS WAF docs read 2026-11-05.

Our checks

CheckResultMethodDate
Homepage fetch HTTP 200 GET with the crawl user agent after a robots.txt check 2026-11-05

Sources

Last reviewed 2026-11-05