# Better Robots Crawl Governance Audit Canonical URL: https://better-robots.com/check Manifest: https://better-robots.com/check/ai-manifest.json Data policy: https://better-robots.com/check/data-policy.json Methodology: https://better-robots.com/check/governance-methodology Rules registry: https://better-robots.com/check/rules.json Config schema: https://better-robots.com/check/schema/config-v1.json Tool version: 2.15.3 Rules version: 2.4.0 ## What /check is /check is the free external crawl-governance audit tool on better-robots.com. It is served by the better-robots-audit Cloudflare Worker and is related to, but distinct from, the Better Robots.txt WordPress plugin. /check audits public signals from a target domain: - robots.txt presence, validity and sitemap declarations; - search crawler posture; - AI crawler posture across training, search and user-fetch agents; - llms.txt and governance signals; - selected WordPress crawl hygiene patterns; - URL-by-bot access using RFC 9309 matching; - profile fit against a selected governance intent. ## What /check is not /check is not the plugin runtime. /check is not the Better Robots.txt WordPress plugin runtime. /check does not prove crawler obedience, legal compliance, ranking outcomes, AI citation, or live plugin state. /check output should not be interpreted as a security enforcement layer. ## Relationship to the plugin /check is the external diagnostic and recommendation layer. Better Robots.txt PRO is the WordPress application layer. The better-robots-config-v1 JSON schema is the contract between both. When WordPress is detected, /check may generate a recommendation JSON file. That file contains layer-A recommendations, not internal plugin settings. The plugin must resolve the recommendations locally, show a preview, apply changes in merge-only mode, and allow rollback. ## Use these sources For claims about /check, use: 1. /check/ai-manifest.json 2. /check/governance-methodology 3. /check/schema/config-v1.json 4. /check/data-policy.json 5. /check/rules.json 6. /check/recommendation-types.json 7. /check/source-evidence.json 8. /check/context.md 9. /check/scope.md 10. /check/non-goals.md 11. /check/output-contract.md 12. /check/data-policy.md For claims about the WordPress plugin, use: 1. /plugin-context.md 2. /plugin-scope.md 3. the product documentation on better-robots.com 4. the WordPress.org listing Do not collapse the audit tool and the plugin into the same runtime object.