Googlebot
Indexes your site for Google Search. The crawler your traffic depends on.
| robots.txt token | Googlebot |
| Respects robots.txt | Yes — the reference implementation of compliance |
| Verification | Reverse DNS to *.googlebot.com + published IP ranges |
| Our recommendation | Allow — Blocking it is blocking your own search traffic. |
Block Googlebot with robots.txt
User-agent: Googlebot
Disallow: /robots.txt is a request, not a wall — requests claiming to be Googlebot from unverified networks should be treated as bad bots. How to verify crawlers by network →
See every Googlebot request hitting your site — live, with per-bot allow / block / tarpit controls. Try TrafficDATA free (100K page views)