← All crawlers

Omgilibot / Webzio

A commercial data broker crawl whose feeds are resold, including into AI training pipelines.

robots.txt tokenomgili
Respects robots.txtInconsistent reports
VerificationLimited public documentation
Our recommendationBlock — Your content resold as someone else's product, with weak transparency.

Block Omgilibot / Webzio with robots.txt

User-agent: omgili
Disallow: /

robots.txt is a request, not a wall — requests claiming to be Omgilibot / Webzio from unverified networks should be treated as bad bots. How to verify crawlers by network →

See every Omgilibot / Webzio request hitting your site — live, with per-bot allow / block / tarpit controls. Try TrafficDATA free (100K page views)

Related crawlers