← All crawlers

PetalBot

Crawls for Huawei's Petal Search and related AI features.

robots.txt tokenPetalBot
Respects robots.txtYes — per documentation; volume complaints are common
VerificationDocumented by Huawei
Our recommendationYour call — Search value is negligible outside Huawei's ecosystem; weigh the crawl load.

Block PetalBot with robots.txt

User-agent: PetalBot
Disallow: /

robots.txt is a request, not a wall — requests claiming to be PetalBot from unverified networks should be treated as bad bots. How to verify crawlers by network →

See every PetalBot request hitting your site — live, with per-bot allow / block / tarpit controls. Try TrafficDATA free (100K page views)

Related crawlers