How well is your site governed for AI crawlers?

A 30-second audit of your robots.txt, llms.txt, and posture toward 20+ AI crawlers (GPTBot, ClaudeBot, Google-Extended, PerplexityBot, and friends).

Website URL Audit my robots.txt

Intent profile

Select the intent profile that defines how this audit reads crawler governance. If you are unsure, use the helper below to recommend one existing profile.

AI search open, training restricted Allow AI search bots (ChatGPT, Claude, Perplexity), block training crawlers. Maximum AI visibility Allow all legitimate AI bots for maximum citation; aggressive scrapers handled elsewhere. Publisher protection Strict training control with selective AI search visibility; for media and editorial sites. WordPress safe default Recommended baseline for typical WordPress sites: AI search OK, training restricted. Strict crawler restriction Block all AI bots; keep only minimal traditional search visibility.

Help me choose my intent profile Four questions can recommend an existing profile before the audit.

Use this helper only if the profile list is unclear. It preselects one existing profile and you can still change the final choice before the audit.

Should traditional search engines be able to crawl the site?

Yes, keep search crawling available Limit crawling as much as possible I am not sure

Do you want to declare a restriction against AI training on your content?

Declare an AI-training restriction Do not restrict AI training in this profile I am not sure

Do you want to allow crawlers used for AI answers or AI search when that supports discoverability?

Allow AI-search and user-request crawlers Restrict AI answer or user-request crawlers I am not sure

What is your main priority?

Balance discoverability and control Maximize discoverability Limit AI use as much as possible Protect editorial or sensitive content Keep a cautious WordPress baseline

This helper only selects an existing profile. It does not create a custom score and does not predict AI visibility, ranking, citation or crawler compliance.

Recommend a profile

Free. No sign-up. Full audit results are cached briefly by domain for performance. We keep the previous score for up to 30 days to show progress, plus short-lived diagnostic attempts for reliability. Long-term stats are aggregated and anonymised.