Expanse (Cortex Xpanse)
Scans the internet to map organizations' attack surfaces for Palo Alto's commercial Cortex Xpanse product. Its UA states its identity and contact in full.
| robots.txt token | Expanse |
| Respects robots.txt | Not applicable — address-space scanning |
| Verification | Self-identifying UA; documented by Palo Alto Networks |
| Our recommendation | Your call — Commercial scanning that's transparent about itself; harmless to most sites. |
Block Expanse (Cortex Xpanse) with robots.txt
User-agent: Expanse
Disallow: /robots.txt is a request, not a wall — requests claiming to be Expanse (Cortex Xpanse) from unverified networks should be treated as bad bots. How to verify crawlers by network →
See every Expanse (Cortex Xpanse) request hitting your site — live, with per-bot allow / block / tarpit controls. Try TrafficDATA free (100K page views)