Agent Ready Crawlers

The field guide to every AI crawler and agent at the door, and the vendors who decide who gets in.

Vendors at the door

In short

15 bot management, agent identity and monetisation vendors, graded on five documented questions and ranked by points out of ten. Akamai, AWS WAF Bot Control, Cloudflare and DataDome tie at 8. Cost and where the product runs are described, not graded. Ora is not ranked because it does not manage bots.

These 15 are the vendors graded on the rubric. The full vendor list profiles 73 companies in four types, with their standards, prices and sources.

Points: yes is 2, partial is 1, not published is 0, over five graded questions. Equal points share a rank and are listed alphabetically. Evidence and dates are on each vendor page.
RankVendorPointsVerifies agentsPer-purpose policyChargingCommerce agentsReportingCost, read 2026-11-04
1=Akamai8YesPartialPartialYesYesNo public price; sales-led
1=AWS WAF Bot Control8YesYesYesNot publishedYesUSD 10/month per web ACL plus USD 1 or USD 10 per million requests after free allowance
1=Cloudflare8YesYesPartialPartialYesFree tier covers AI Crawl Control; Pro from USD 20/month; Bot Management and BotBase are Enterprise and sales-led
1=DataDome8YesPartialYesPartialYesFrom USD 3,830/month
5HUMAN Security7YesYesPartialNot publishedYesNo public price; sales-led
6=Skyfire6YesNot its jobYesYesNot publishedNot published (checked 2026-11-04)
6=TollBit6PartialPartialYesNot publishedYesFree for publishers to start
6=Vercel6YesYesNot publishedNot publishedYesBasic free; Deep Analysis USD 1 per 1,000 checks on Pro
9Kasada5YesPartialNot publishedNot publishedYesNo public price; sales-led
10Fastly4PartialPartialPartialPartialNot publishedNo public price; sales-led
11=Arcjet3PartialPartialNot publishedNot publishedPartialFrom USD 25/month plus USD 5 per 1M web requests
11=Auth0 for AI Agents3Not its jobPartialNot publishedPartialPartialAI Agents add-on at 50 percent of base plan, from USD 18/month; free plan (checked 2026-11-05)
11=Imperva3PartialNot publishedNot publishedNot publishedYesNo public price; sales-led
14Stytch IsAgent2PartialNot publishedNot publishedNot publishedPartialIsAgent free to 10,000 calls/month; fingerprints USD 0.005 each beyond 10,000
15Netlify1Not publishedPartialNot publishedNot publishedNot publishedPlatform plans from USD 0; extension price not stated

What the ranking does and does not say

Akamai, AWS WAF Bot Control, Cloudflare and DataDome tie at the top with 8 of 10, so the ranking cannot separate them. They differ in what they are strong at: Akamai has 3 yes grades, AWS WAF Bot Control has 4 yes grades, Cloudflare has 3 yes grades, DataDome has 3 yes grades. The profiles list what each does not do.

A vendor that does one job well can rank low on a broad rubric. Not its job counts as zero, so identity and monetisation products such as Skyfire, TollBit and Stytch IsAgent sit below the bot management suites. Read the row for the job you need, not the rank.

Grades come from what each vendor documents on its own site, read 2026-11-04. We have not tested the products. A vendor's description of itself is a vendor claim, and the profiles label it. Ora does not manage bots, so it has no row here; the method page says where it fits.

The rubric

Can it tell a verified agent from a spoof?
Yes where the vendor documents verification by Web Bot Auth signatures, IP validation or reverse DNS. Partial where it depends on partners, lists only or an unconfirmed method. Not published where nothing is documented.
Can it express a policy per purpose (train, search, answer, act)?
Yes where separate controls exist for crawler purposes or for named bot categories. Partial where policy is per bot or per category without a purpose split.
Does it support pay-per-crawl or any charging?
Yes where charging is generally available. Partial where it is in beta or runs through a partner. Not published where the vendor documents none.
Does it let signed commerce agents (Visa TAP, Mastercard Agent Pay) through without custom work?
Yes where support is documented as shipped or announced with named integrations. Partial where support is built on Web Bot Auth but the rule is not confirmed in documents. Not published otherwise.
What does it cost? (not graded)
Quoted from the vendor with the date read. Not graded: a free tier is not better or worse than a sales-led price for every reader.
What does it report?
Yes where AI or bot activity dashboards, analytics or logs are documented. Partial where reporting is limited to general bot analytics.
Does it work at the edge or in the app? (not graded)
Described as the vendor documents it. Not graded.

Head-to-heads and alternatives

30 head-to-head pages cover the pairs a buyer is most likely to search; every vendor also has an alternatives page. Start from a profile: Akamai, AWS WAF Bot Control, Cloudflare, DataDome, HUMAN Security, Skyfire and the rest.

Sources

Last reviewed 2026-11-04