--- title: "Known Agents: bot management vendor profile | Agent Ready Crawlers" description: "Known Agents: bot management vendor profile covering Agent Analytics, Automatic Robots.txt, Bad Bot Blocking and 1 more. Read 2026-11-05." canonical: https://agentreadycrawlers.com/vendors/known-agents site: "Agent Ready Crawlers" last_updated: 2026-11-05 section: "Vendors" --- # Known Agents: bot management vendor profile | Agent Ready Crawlers > Known Agents: bot management vendor profile covering Agent Analytics, Automatic Robots.txt, Bad Bot Blocking and 1 more. Read 2026-11-05. Source: https://agentreadycrawlers.com/vendors/known-agents Site: Agent Ready Crawlers Last reviewed: 2026-11-05 Bot management vendor # Known Agents In short Known Agents began in 2023 as Dark Visitors, a side project listing eight AI bots, and now serves a public agent directory that anyone can submit to. Customers feed it traffic from server-side hooks in CDNs and clouds; a free tier of one project suits small sites, and Growth costs USD 299 a month. Type [Bot management](https://agentreadycrawlers.com/vendors/by-type/bot-management/) Homepage [knownagents.com](https://knownagents.com) In one line Agent analytics and access-control service, formerly Dark Visitors, that identifies AI agents and crawlers from server-side data, keeps an automatic robots.txt current, and blocks bots that ignore it or spoof trusted identities. Last read 2026-11-05 ## What Known Agents does for this layer ### From the vendor's own pages Known Agents says it began in 2023 as Dark Visitors, a side project documenting the eight known AI bots then on the web, and was founded in New York City. ([knownagents.com](https://knownagents.com/about)) Known Agents' Automatic Robots.txt keeps crawler rules current as new agents appear, and its Bad Bot Blocking enforces them against bots that ignore robots.txt or spoof trusted identities. ([knownagents.com](https://knownagents.com/about)) Known Agents collects traffic server-side through WordPress, Cloudflare, Fastly, Akamai, AWS, Google Cloud, Vercel, Node.js and REST API integrations. ([knownagents.com](https://knownagents.com/about)) Known Agents' Agent Identification returns fields such as agent\_token, agent\_type\_name and operator\_name with a verification result for each request. ([knownagents.com](https://knownagents.com/)) Known Agents prices Free at USD 0 for one project and 100,000 events, Startup at USD 29 a month for 1 million events, and Growth at USD 299 a month for 10 million events. ([knownagents.com](https://knownagents.com/pricing)) Known Agents runs a public agent directory with a Submit an Agent form, listing entries such as Google-Agent, ElevenlabsBot and QualifiedBot. ([knownagents.com](https://knownagents.com/agents)) ### Claims the vendor makes about itself Known Agents says more than 5,000 websites use the platform. ([knownagents.com](https://knownagents.com/about)) Known Agents' about page states "We are not an anti-bot company." ([knownagents.com](https://knownagents.com/about)) ### What our crawl saw darkvisitors.com redirected to knownagents.com when fetched with the crawl user agent on 2026-11-05. ([darkvisitors.com](https://darkvisitors.com/)) ## Products and plans | Product | What it does | Price model | From | As of | | --- | --- | --- | --- | --- | | Agent Analytics | Server-side analytics of AI agents, crawlers and scrapers, including robots.txt violations. | monthly by events Startup USD 29, Growth USD 299 a month; Enterprise custom. | USD 0 | 2026-11-05 | | Automatic Robots.txt | Robots.txt rules that update as new bots are found. | No price recorded | | Bad Bot Blocking | Request-time blocking of bots that ignore robots.txt or spoof identities. | No price recorded | | Agent Identification | API that names and verifies agents from incoming requests. | No price recorded | ## Standards | Standard | Status | Evidence | | --- | --- | --- | | RFC 9309 (robots.txt) | Supports | Automatic Robots.txt publishes and updates robots.txt rules for compliant crawlers. (knownagents.com) | | Web Bot Auth | No statement | Known Agents pages read 2026-11-05 do not name the verification method. | ## Our checks | Check | Result | Method | Date | | --- | --- | --- | --- | | Homepage fetch | HTTP 200 | GET with the crawl user agent after a robots.txt check | 2026-11-05 | ## What Known Agents does not do - Known Agents' pages read do not say how it verifies agents; Web Bot Auth, IP lists and reverse DNS are not named (read 2026-11-05). - Known Agents does not charge AI crawlers for access on a site owner's behalf. ## Related pages on this site - [All bot management vendors](https://agentreadycrawlers.com/vendors/by-type/bot-management/) 23 profiles - [The full vendor list](https://agentreadycrawlers.com/vendors/) 73 profiles in four types - [Google-Agent](https://agentreadycrawlers.com/crawlers/google-agent/) no token ## Sources - [knownagents.com](https://knownagents.com) read 2026-11-05 - [Dark Visitors (redirects to Known Agents)](https://darkvisitors.com/) read 2026-11-05 - [About Known Agents | A Toolkit for the Agentic Web](https://knownagents.com/about) read 2026-11-05 - [Track, control, and optimize for AI agents and bots | Known Agents](https://knownagents.com/) read 2026-11-05 - [Pricing | Known Agents](https://knownagents.com/pricing) read 2026-11-05 - [Agent Directory | Known Agents](https://knownagents.com/agents) read 2026-11-05 Last reviewed 2026-11-05