Agent Ready Crawlers

The field guide to every AI crawler and agent at the door, and the vendors who decide who gets in.

Crawler operator

Browser Use

In short

Browser Use sells hosted cloud browsers that run a hardened Chromium with stealth fingerprints, residential proxies and CAPTCHA solving switched on by default, at USD 0.02 an hour plus proxy traffic. Nothing in its documentation names these browsers to a site, so an allow rule at a WAF has nothing to match.

Type
Crawler operator
Homepage
browser-use.com
In one line
Maker of the open-source browser-use agent library and a hosted cloud browser for agents that ships with stealth fingerprinting, residential proxies and CAPTCHA solving on by default, and no published identifier for site owners.
Last read
2026-11-05

What Browser Use does for this layer

From the vendor's own pages

Browser Use sells Browser Use Agents, which complete web tasks, and Browser Infrastructure, a cloud browser that developers connect to with Playwright or Puppeteer over CDP. (browser-use.com) Browser Use's stealth docs say every cloud session runs a hardened Chromium fork with stealth enabled by default, randomising canvas, WebGL, font and navigator fingerprints per session "to appear as a real user". (docs.browser-use.com) Browser Use enables residential proxies by default across 195+ countries, which its docs say makes sessions "appear as real users from the target geography". (docs.browser-use.com) Browser Use's docs say its cloud browsers solve CAPTCHAs automatically and help with sites protected by Cloudflare, PerimeterX and other detection services, while access to every site is not guaranteed. (docs.browser-use.com)

Browser Use fixes the browser window size by default because, its docs say, "resizing makes a browser easier to detect". (docs.browser-use.com) Browser Use prices cloud browsers at USD 0.02 an hour plus USD 5 per GB of residential proxy traffic, and web agents at model cost plus a 20 percent fee. (browser-use.com)

Claims the vendor makes about itself

Browser Use markets its cloud browser as "The cloud browser that gets past bot walls" and says that across 200 visits to 100 bot-protected sites headless Chrome got through on 3.0 percent and Browser Use on 90.5 percent. (browser-use.com) Browser Use's homepage shows the open-source library under the MIT licence with 119,000 GitHub stars. (browser-use.com)

What our crawl saw

The Browser Use documentation index read on 2026-11-05 lists pages for stealth, proxies and CAPTCHA handling and none for a user agent token, robots.txt policy or Web Bot Auth signing. (docs.browser-use.com)

Products and plans

ProductWhat it doesPrice modelFromAs of
Browser Infrastructure (cloud browsers) Stealth Chromium sessions driven over CDP, with residential proxies and CAPTCHA solving. usage-based Per browser-hour, plus USD 5 per GB of residential proxy traffic. USD 0.02 2026-11-05
Browser Use Agents Hosted agents that complete web tasks. usage-based Plus browser time and traffic. Model cost plus 20 percent 2026-11-05
browser-use (open source) MIT-licensed Python library for browser agents. No price recorded

Standards

StandardStatusEvidence
RFC 9309 (robots.txt) No statement No robots.txt page in the docs index (2026-11-05).
Web Bot Auth No statement No signing feature in the docs index; key directory 404 at browser-use.com (2026-11-05).
Published IP list No statement No egress IP list; sessions use residential proxies by default.

Our checks

CheckResultMethodDate
Homepage fetch HTTP 200 GET with the crawl user agent after a robots.txt check 2026-11-05
Web Bot Auth key directory HTTP 404, text/html GET https://browser-use.com/.well-known/http-message-signatures-directory with the crawl user agent after a robots.txt check 2026-11-05

What Browser Use does not do

  • Browser Use publishes no user agent token, robots.txt policy or signing keys for its cloud browsers; its docs describe the aim of appearing as a real user instead (checked 2026-11-05).
  • A site cannot allow Browser Use as a named agent at its WAF, because the vendor publishes no identifier or key directory.

Sources

Last reviewed 2026-11-05