Meta-ExternalAgent
Meta's crawler for collecting web content used in AI model training and product improvement.
| robots.txt token | meta-externalagent |
| Respects robots.txt | Yes — per Meta's documentation |
| Verification | Documented by Meta with published IP ranges |
| Our recommendation | Your call — Standard one-sided training trade; documented and blockable. |
Block Meta-ExternalAgent with robots.txt
User-agent: meta-externalagent
Disallow: /robots.txt is a request, not a wall — requests claiming to be Meta-ExternalAgent from unverified networks should be treated as bad bots. How to verify crawlers by network →
See every Meta-ExternalAgent request hitting your site — live, with per-bot allow / block / tarpit controls. Try TrafficDATA free (100K page views)