Skip to content

Quick Start

This is the fastest safe path through Better Robots.txt.

Step 1 — Choose an edition

  • Free for the Essential path
  • Pro for AI-First and deeper governance
  • Premium for Fortress and the strictest protection-first setup

Step 2 — Pick a preset

  • Essential for most sites
  • AI-First if AI governance matters early
  • Fortress if protection is the priority
  • Custom if you already know what to configure manually

Step 3 — Walk through the critical stages

At minimum, review:

  • Search Engine Visibility
  • AI & LLM Governance
  • Global Settings
  • E-commerce Optimization (if relevant)
  • Review & Save

Step 4 — Verify before publish

Use Review & Save to confirm the generated output before saving.

Step 5 — Validate the result

Check:

  • /robots.txt
  • /llms.txt if enabled
  • sitemap lines
  • expected crawler rules

Better Robots.txt — human-friendly, machine-first documentation for WordPress crawl governance.