Can AI find your site?
We read your robots.txt against 11 named AI crawlers — GPTBot, ClaudeBot, PerplexityBot, Google-Extended, OAI-SearchBot, and the rest. We fetch your sitemap, look for llms.txt, and probe whether your CDN is quietly turning AI bots away while robots.txt waves them in.
The CDN check is the one most audits miss. We fingerprint Cloudflare, Akamai, AWS WAF, Fastly, Sucuri, Vercel, and Netlify — and tell you when there's a gap between your policy and what's actually shipping.
CDN fingerprinting · 11 named bots