Agent Ready Crawlers

The field guide to every AI crawler and agent at the door, and the vendors who decide who gets in.

Vendor, ranked 10 of 15

Fastly

In short

Fastly is an edge cloud whose WAF signals and Bot Management product cover agents only in part: verification, per-purpose policy, charging and commerce agents each grade partial, and reporting is not published, for 4 of 10 points. Fastly publishes no price for Bot Management, which an Essential-tier Next-Gen WAF customer cannot buy at all.

Edge cloud vendor whose Bot Management adds signals for suspected and verified AI crawlers and fetchers, lets sites block, throttle, deceive or allow them, and can redirect them to a TollBit paywall. Vendor description of itself, checked against its documents on 2026-11-04.

Alternatives to Fastly ยท fastly.com

Type
Bot management
Homepage
fastly.com
Last read
2026-11-05

The rubric, with evidence

QuestionGradeWhat the vendor documentsEvidence
Tells a verified agent from a spoof Partial verified-bot signals for AI crawlers and fetchers; Skyfire credentials at the edge (announced); Web Bot Auth not found in docs (checked 2026-11-04) Signals listed in Fastly-TollBit blog. Source, read 2026-11-04.
Per-purpose policy (train, search, answer, act) Partial crawler versus fetcher signals, suspected versus verified Four separate AI bot signals. Source, read 2026-11-04.
Charging for access Partial through TollBit paywall redirect Fastly-TollBit blog. Source, read 2026-11-04.
Lets signed commerce agents through Partial Skyfire KYA/KYAPay partnership (Jun 2026); no Visa TAP or Mastercard Agent Pay found Skyfire partnership release. Source, read 2026-11-04.
Cost Not graded no public price; sales-led Pricing page lists Bot Management as contact sales. Source, read 2026-11-04.
Reporting Not published AI bot reporting not described on pages read (checked 2026-11-04) Product and docs pages read. Source, read 2026-11-04.
Where it runs Not graded edge: classification and actions on Fastly's edge network AI Bot Management and TollBit flow. Source, read 2026-11-04.

Cost

no public price for Bot Management or AI Bot Management; contact sales (checked 2026-11-04). Free tier covers up to 100,000 requests/month for delivery. Source, read 2026-11-04.

What Fastly does not do

Documented facts

Features are as the vendor documents them; we have not tested them. A claim a vendor makes about itself is marked as a vendor claim.

Dated news

Compared with

What Fastly does for this layer

From the vendor's own pages

Fastly's client fingerprinting uses JA3 and JA4 TLS fingerprints to identify client types. (docs.fastly.com, dated 2026-10-13) Fastly's client challenges come in dynamic, interactive and non-interactive forms; dynamic challenges can use Private Access Tokens and non-interactive ones use a JavaScript proof-of-work. (docs.fastly.com, dated 2026-10-13) Bot operators apply for Fastly's Verified Bot categories through a submission form on community.fastly.com. (docs.fastly.com, dated 2026-10-13) Fastly's VCL variable fastly.bot.category.is_verified reports whether a detected bot is a self-identified bot that Fastly has validated. (fastly.com)

Claims the vendor makes about itself

Fastly's AI Bot Management page offers to block, intercept or deceive verified or suspected AI bots that scrape content without consent. (fastly.com)

Products and plans

ProductWhat it doesPrice modelFromAs of
Bot Management ContentGuard edge detection, client fingerprinting, client challenges, advanced client-side detections and verified bots. contact sales Requires Full-Site Delivery or Streaming Delivery. Not published 2026-11-05
Next-Gen WAF AI bot signals SUSPECTED-BOT and VERIFIED-BOT signals for AI crawlers and AI fetchers usable in lists, rate limit rules and request rules. No price recorded

Standards

StandardStatusEvidence
Web Bot Auth No statement The Bot Management product description (updated 2026-10-13) does not mention Web Bot Auth or HTTP message signatures.
Visa Trusted Agent Protocol No statement No statement found in the Fastly docs read 2026-11-05.
Mastercard Agent Pay No statement No statement found in the Fastly docs read 2026-11-05.

Our checks

CheckResultMethodDate
Homepage fetch HTTP 200 GET with the crawl user agent after a robots.txt check 2026-11-05

Sources

Last reviewed 2026-11-05