Installation
Requirements
- WordPress with administrator access
- PHP
7.4+
Install from WordPress.org
- Go to Plugins → Add New
- Search for
Better Robots.txt - Install and activate the plugin
First Launch
After activation:
- Open Better Robots.txt
- Choose a mode on the
Mode Selectionscreen - Click Configure
- Walk through the numbered steps
- Review the preview in
Step 14 - Review & Save - Save from the sticky footer
Important Physical File Check
If your site already has a physical /robots.txt file in the web root, virtual mode can be blocked. The settings screen shows a warning when that happens.
Verify the Installation
- Visit
https://yoursite.com/robots.txt - If you enabled
llms.txt, visithttps://yoursite.com/llms.txt
If Something Looks Wrong
- Re-save permalinks in Settings → Permalinks
- Make sure Settings → Reading → Search Engine Visibility is not discouraging indexing
- Check for a physical
/robots.txtfile - Check the preview in the final step before saving