Agent Ready Crawlers

The field guide to every AI crawler and agent at the door, and the vendors who decide who gets in.

News from 2026-08-19

Google retires the Google-NotebookLM user agent

In short

19 August 2026: Google retires the Google-NotebookLM user agent. The page, last updated 2026-08-19, also lists Google-Agent and its experimental Web Bot Auth identity. Google-GeminiNotebook is Google's live answer fetcher. Google-Agent is Google's browsing agent. Rows affected in this site: Google-GeminiNotebook and Google-Agent.

Google's user-triggered fetcher list now names Google-GeminiNotebook for URLs users add as sources and marks the former Google-NotebookLM string as supported until August 2026. The page, last updated 2026-08-19, also lists Google-Agent and its experimental Web Bot Auth identity.

Primary source developers.google.com/crawling/docs/crawlers-fetchers/google-user-triggered-fetchers, read 2026-11-04.

Where it stands in the Index

Google-GeminiNotebook
Google, live answer fetch. No robots.txt token. Verification: ip list.
Google-Agent
Google, task agent. No robots.txt token. Verification: web bot auth.

All news.

Sources

Last reviewed 2026-11-04