← All crawlers

YouBot

Crawls for You.com's AI search engine.

robots.txt tokenYouBot
Respects robots.txtYes
VerificationDocumented by You.com
Our recommendationAllow — Small but citing search engine — low cost, some upside.

Block YouBot with robots.txt

User-agent: YouBot
Disallow: /

robots.txt is a request, not a wall — requests claiming to be YouBot from unverified networks should be treated as bad bots. How to verify crawlers by network →

See every YouBot request hitting your site — live, with per-bot allow / block / tarpit controls. Try TrafficDATA free (100K page views)

Related crawlers