Wizard Overview

Better Robots.txt uses a preset selection screen followed by a structured settings flow.

Flow structure

• Step 0 — Preset selection
• Step 1 — Search Engine Visibility
• Step 2 — AI & LLM Governance
• Step 3 — SEO Tool Protection
• Step 4 — Bad Bots Protection
• Step 5 — Archive & Wayback Control
• Step 6 — Global Settings
• Step 7 — Spam, Feeds & Crawl Traps
• Step 8 — E-commerce Optimization
• Step 9 — Resources & Assets
• Step 10 — Social Media Crawlers
• Step 11 — Ads & Revenue
• Step 12 — LLMS.txt File
• Step 13 — Advanced Settings
• Step 14 — Review & Save

Browse the detailed pages from the Settings section in the sidebar.