ClaudeBot
Collects public web content for training and improving Anthropic's Claude models.
| robots.txt token | ClaudeBot |
| Respects robots.txt | Yes — documented and generally observed |
| Verification | Documented by Anthropic; covered by Cloudflare's verified-bot list |
| Our recommendation | Your call — Same trade as GPTBot: well-behaved, but nothing flows back. |
Block ClaudeBot with robots.txt
User-agent: ClaudeBot
Disallow: /robots.txt is a request, not a wall — requests claiming to be ClaudeBot from unverified networks should be treated as bad bots. How to verify crawlers by network →
See every ClaudeBot request hitting your site — live, with per-bot allow / block / tarpit controls. Try TrafficDATA free (100K page views)