AhrefsBot
Builds Ahrefs' backlink index. Heavy crawler; useful to you only if you (or your competitors' analysts) use Ahrefs.
| robots.txt token | AhrefsBot |
| Respects robots.txt | Yes |
| Verification | Documented by Ahrefs |
| Our recommendation | Your call — Allow if you use SEO tooling; block if the crawl load buys you nothing. |
Block AhrefsBot with robots.txt
User-agent: AhrefsBot
Disallow: /robots.txt is a request, not a wall — requests claiming to be AhrefsBot from unverified networks should be treated as bad bots. How to verify crawlers by network →
See every AhrefsBot request hitting your site — live, with per-bot allow / block / tarpit controls. Try TrafficDATA free (100K page views)