Meta: 7 rows
In short
Meta has 7 rows in the Index: Meta-ExternalAgent, Meta-ExternalFetcher, Meta-WebIndexer, Meta-ExternalAds, FacebookExternalHit, FacebookBot and Muse. They cover 5 purposes: training, live answer fetch, search index, other, shopping agent. 6 of them have a robots.txt token and 7 publish nothing a site can verify. The most refused is Meta-ExternalAgent, disallowed at the root by 16.0 percent of top-10,000 sites.
| Operator | Token | Block rate |
|---|---|---|
| Meta | meta-externalagent | 16.0% |
| Meta | meta-externalfetcher | 8.5% |
| Meta | meta-webindexer | |
| Meta | meta-externalads | |
| Meta | facebookexternalhit | |
| Meta | FacebookBot | 10.2% |
| Meta | Muse (personal agent) |
Vendor profile: Meta, with its products, standards, our probes and what it does not do.
Verification Ledger entry
- Summary
- User agent strings only; the page recommends IP allowlisting but links no list. Publishes nothing for Muse.
- IP lists
- publishes nothing
- Reverse DNS
- publishes nothing
- Key directory
- publishes nothing
- Cloudflare
- not checked
- Visa and Mastercard
- Visa TAP: no public operator-level registration found (checked 2026-11-04). Mastercard Agent Pay: no public operator-level registration found (checked 2026-11-04).
Block rates for Meta tokens
| Token | Refused, top 10,000 | Named | Via * | All crawled |
|---|---|---|---|---|
| Meta-ExternalAgent | 16.0% | 12.3% | 3.7% | 12.0% |
| FacebookBot | 10.2% | 6.4% | 3.7% | 7.3% |
| Meta-ExternalFetcher | 8.5% | 4.7% | 3.8% | 6.0% |
Based on 5,938 top-10,000 sites with a parsed robots.txt; crawl of 2026-11-04.
In the news
- 2026-10-15DataDome Q3 report: 25 billion AI agent requests
- 2026-09-08Meta launches Muse, a personal agent that does not identify itself
Sources
Last reviewed 2026-11-04