Skip to content

Spam, Feeds & Crawl Traps

Location: Step 7 - Spam, Feeds & Crawl Traps

This step groups five cleanup toggles:

  • Block Feed Crawlers
  • Block Author Archives
  • Block Comment Spam Params
  • Block WordPress Search URLs
  • Block Common Trap Parameters

What These Toggles Cover

  • feed URLs
  • author archives
  • comment-spam parameters
  • WordPress search URLs
  • common crawl-trap parameters

Plan Notes

  • Advanced spam and crawl-trap protection depends on plan level

Better Robots.txt — human-friendly, machine-first documentation for WordPress crawl governance.