Skip to content

Features Overview

This page summarizes the features available in the guided setup flow.

Setup Flow

  • A dedicated Mode Selection screen
  • 14 numbered configuration steps
  • A generated robots.txt preview inside Step 14 - Review & Save
  • A sticky Save Changes bar available throughout the flow

Modes

  • Mode 1: Essential Free preset
  • Mode 2: AI-First Pro preset
  • Mode 3: Fortress Premium preset
  • Mode 0: Custom Manual configuration

What the Plugin Currently Generates

  • Base WordPress allow/disallow rules
  • Optional sitemap lines from a manual URL
  • Optional sitemap auto-detection
  • Search-engine visibility presets
  • AI training-bot blocking
  • AI search-engine blocking or allowance
  • SEO tool crawler blocking
  • Curated bad-bot blocking
  • Archive-service blocking on Premium
  • WooCommerce cleanup rules
  • CSS/JS and image allow rules
  • Social-media crawler blocking
  • ads.txt and app-ads.txt allow rules
  • Custom rules and optional crawl delay
  • Optional consolidation of output by User-agent
  • Optional SSA header links
  • Optional virtual llms.txt on Pro and Premium

Important Notes

  • The preview is part of Step 14 - Review & Save
  • The llms.txt feature lets you publish your own file content at /llms.txt
  • The plugin includes a default Better Robots.txt signature that can be shown or hidden

Where to Go Next

© 2025 Pagup. Better Robots.txt. AI-Ready, Advanced WordPress Robots.txt Management for SEO.