AI2Bot
Collects web content for the Allen Institute's open AI research models.
| robots.txt token | AI2Bot |
| Respects robots.txt | Yes |
| Verification | Documented by AI2 |
| Our recommendation | Your call — Research-oriented and polite; the usual training trade-off applies. |
Block AI2Bot with robots.txt
User-agent: AI2Bot
Disallow: /robots.txt is a request, not a wall — requests claiming to be AI2Bot from unverified networks should be treated as bad bots. How to verify crawlers by network →
See every AI2Bot request hitting your site — live, with per-bot allow / block / tarpit controls. Try TrafficDATA free (100K page views)