Skip to content

Presets

Presets help you start from a policy model instead of a blank robots.txt.

For many WordPress websites, the preset is the smartest place to begin. You can refine later.

For most websites, start with Essential.

Essential

Best for

  • most WordPress sites
  • small business websites
  • site owners who want a safe and practical first setup

Why choose it

  • It improves the default setup without pushing the site into a restrictive policy too early.
  • It is the easiest place to start if you are not technical.
  • It gives you a guided path before you decide whether stricter controls are even necessary.

Not ideal for

  • sites that already know they need deeper AI or archive controls
  • users who have a clear reason to pursue a stricter protection-first stance

AI-First

Best for

  • publishers
  • blogs and editorial teams
  • content sites that want to express clearer AI usage preferences

Why choose it

  • It introduces deeper AI and LLM governance without turning the site into a hard lockdown.
  • It is the right fit when you want your policy to distinguish more clearly between search, answer generation, and training.

Not ideal for

  • people who only need a basic safer default
  • people who do not need paid controls at all

Fortress

Best for

  • protection-first sites
  • stricter publishing teams
  • websites that want stronger controls around archive, bots, and scraping

Why choose it

  • It is the strictest guided option in the product.
  • It is useful when openness is not your first priority.
  • It fits cases where archive capture, scraping, or broader bot exposure is a real concern.

Not ideal for

  • beginners who simply need a clean default configuration
  • sites that benefit from a more open discovery model

Custom

Best for

  • advanced users
  • agencies
  • people who want to build the policy module by module

Why choose it

  • It gives more freedom when you already understand the trade-offs.
  • It is the right option when your site does not fit neatly into a standard preset profile.

Not ideal for

  • users who are still learning how different crawler categories affect their site
  • people who want the fastest safe starting point

Presets by business type

Business typeRecommended preset
Small business websiteEssential
Content publisherAI-First
WooCommerce storeEssential or AI-First
Protection-first or archive-sensitive siteFortress
Agency / advanced userCustom

Common mistakes

  • Choosing Fortress too early without understanding the trade-offs
  • Expecting a preset to act like a firewall
  • Overblocking social or useful discovery bots without a clear reason
  • Starting with Custom before you understand the product logic

Continue

Better Robots.txt — human-friendly, machine-first documentation for WordPress crawl governance.