How well is your site governed for AI crawlers?

A 30-second audit of your robots.txt, llms.txt, and posture toward 20+ AI crawlers (GPTBot, ClaudeBot, Google-Extended, PerplexityBot, and friends).

AI policy URL (optional)

If your AI policy already exists under a custom path, provide its public same-domain URL or path, such as /ai-policy/.

Intent profile

Pick the AI-governance posture you want for this site. The audit below is scored against this profile. Change it to compare.

AI search open, training restricted Allow AI search bots (ChatGPT, Claude, Perplexity), block training crawlers. Maximum AI visibility Allow all legitimate AI bots for maximum citation; aggressive scrapers handled elsewhere. Publisher protection Strict training control with selective AI search visibility; for media and editorial sites. WordPress safe default Recommended baseline for typical WordPress sites: AI search OK, training restricted. Strict crawler restriction Block all AI bots; keep only minimal traditional search visibility.

Free. No sign-up. Full audit results are cached briefly by domain for performance. We keep the previous score for up to 30 days to show progress, plus short-lived diagnostic attempts for reliability. Long-term stats are aggregated and anonymised.

How well is your site governed for AI crawlers?

What we check

Presence & validity

AI crawler coverage

Modern AI signals

Hygiene

Versioned governance checks, deterministic