SemrushBot
Crawls for Semrush's SEO index.
| robots.txt token | SemrushBot |
| Respects robots.txt | Yes |
| Verification | Documented by Semrush |
| Our recommendation | Your call — Same trade as AhrefsBot. |
Block SemrushBot with robots.txt
User-agent: SemrushBot
Disallow: /robots.txt is a request, not a wall — requests claiming to be SemrushBot from unverified networks should be treated as bad bots. How to verify crawlers by network →
See every SemrushBot request hitting your site — live, with per-bot allow / block / tarpit controls. Try TrafficDATA free (100K page views)