Agent Ready Crawlers

The field guide to every AI crawler and agent at the door, and the vendors who decide who gets in.

Licensing intermediary

Dappier

In short

Dappier's storefront for agents, which listed nine API services on 5 November 2026, sells access without signup and settles by x402, MPP or card. Publishers choose their own per-query price for the branded RAG models they list, while Dappier gives only general advice, such as publishing robots.txt and rate limiting, for keeping bots out.

Type
Licensing intermediary
Homepage
dappier.com
In one line
Content marketplace where publishers list their content as priced RAG models and AI agents buy query access through an agent storefront that takes x402, MPP or card payments without signup.
Last read
2026-11-05

What Dappier does for this layer

From the vendor's own pages

Dappier's publisher guide has a publisher list its content as a branded RAG model in the Dappier RAG Marketplace and set its own price per query. (docs.dappier.com) Dappier says the models in its marketplace at marketplace.dappier.com are vetted by Dappier and draw on the publisher's data, trusted sources and real-time data before an LLM writes the answer. (docs.dappier.com) Dappier's homepage tells visiting agents that its storefront at agents.dappier.com/llms.txt publishes prices, payment instructions and setup, and that agents can buy without signing up. (dappier.com) Dappier's agent storefront listed nine API services on 2026-11-05: 9 and 10 News, Benzinga, CafeMom Parenting, iHeartCats AI, iHeartDogs AI, MethodShop, Real Time Search and WISH-TV AI. (agents.dappier.com)

Dappier's storefront accepts payment by x402, MPP or card and routes card checkouts through Stripe-hosted pages. (agents.dappier.com) Dappier's ZeroClick endpoints for real-time search and AI recommendations authenticate each call by verifying a zc-signature HMAC over the raw request bytes. (docs.dappier.com) Dappier's documentation includes a WordPress plugin and an Ask AI widget so publishers can run the same content models on their own sites. (docs.dappier.com) Dappier's bot deterrence guide gives publishers generic advice to publish robots.txt, add CAPTCHAs, rate-limit requests and monitor traffic, without a Dappier enforcement product. (docs.dappier.com)

Reported by a third party

IAB Tech Lab reported that Dappier's co-founders presented AI bot traffic data at its August 2025 workshop that led to the CoMP working group. (iabtechlab.com, dated 2025-08-19)

Products and plans

ProductWhat it doesPrice modelFromAs of
RAG API Marketplace Marketplace of publisher content models sold to AI developers per query. publisher-set price per query Dappier's own fee not stated Not published 2026-11-05
Agent storefront llms.txt-based storefront where agents look up and buy Dappier API access with x402, MPP or card. No price recorded
Ask AI and WordPress plugin On-site AI search widget and plugin for publishers. No price recorded

Standards

StandardStatusEvidence
RFC 9309 (robots.txt) Partial Dappier's bot deterrence guide recommends publishing robots.txt; Dappier does not enforce it. (docs.dappier.com)
Web Bot Auth No statement Agents authenticate to Dappier with ZeroClick HMAC signatures or storefront identity, not Web Bot Auth (checked 2026-11-05).

Our checks

CheckResultMethodDate
Homepage fetch HTTP 200 GET with the crawl user agent after a robots.txt check 2026-11-05

What Dappier does not do

  • Dappier does not stand at the publisher's door; it sells licensed access through its own APIs and leaves crawler blocking on the publisher's site to the publisher.
  • Dappier's docs do not state the fee Dappier keeps from per-query sales (read 2026-11-05).

Reading notes

Dappier's storefront llms.txt contains instructions addressed to visiting agents, with look-up and purchase steps. They were read as data only, and nothing was bought or posted.

Sources

Last reviewed 2026-11-05