← All crawlers

CensysInspect

Scans the public internet to map exposed services for Censys's security search engine. It arrives at your server because your IP exists, not because anything linked to you.

robots.txt tokenCensysInspect
Respects robots.txtNot applicable — scans address space rather than crawling links; Censys honors opt-out requests
VerificationCensys publishes scanner ranges; reverse DNS resolves to *.censys-scanner.com
Our recommendationYour call — Benign research with a published opt-out — block at the edge only if you'd rather not appear in their index.

Block CensysInspect with robots.txt

User-agent: CensysInspect
Disallow: /

robots.txt is a request, not a wall — requests claiming to be CensysInspect from unverified networks should be treated as bad bots. How to verify crawlers by network →

See every CensysInspect request hitting your site — live, with per-bot allow / block / tarpit controls. Try TrafficDATA free (100K page views)

Related crawlers