Online store – Better Robots.txt by Pagup

Plugin – Better Robots.txt SEO PRO

Starting as low as: $5.99/month or $46.99/Year (-35%)

Get the PRO-SEO Version

Proudly made in    by & 100% compatible with 



  • Better Robots.txt plugins are translated and available in: Chinese –汉语/漢語, English, French – Français, Russian –Руссɤɢɣ, Portuguese – Português, Spanish – Español.

Better Robots.txt Pro is a game changer. This plugin, based on thousands of SEO analysis, was specifically made to boost your site ranking and correct a recurrent problematic of content indexation (present on more than 95% Wordpress websites).

Better Robots.txt Pro helps you create a virtual Robots.txt file with simple clicks, add in specific instructions for most popular web robots (including a Crawl-Delay feature) as well as your sitemap URL (generated from Yoast SEO plugin) or any other sitemap. Better robots will also help you block bad bots known for scraping (illegally) large amount of data.

  • Last update: Backlink protector – Avoid competitors from identifying your profitable backlinks.

This plugin was also designed to make direct modifications inside the Robots.txt and increase your SEO by taking advantage of a natural part of every website that rarely gets talked about.

More infoWhen Better Robots.txt joins the performance of Yoast SEO

Get prepared for MASSIVE TRAFFIC 


The robots.txt file: a source of SEO juice just waiting to be unlocked.

How to optimize Better Robotx.txt and your Robots.tx file ? See the video


Better Robots.txt was made by Pagup – Agence SEO, a SEO agency based in Canada (Qc) specialized in the practice of “onPage” search engine optimization aiming to increase the amount of visitors to Websites by obtaining high-ranking placements in the search results page of search engines (SERP).

After thousands of SEO analysis, a recurrent pattern was identified on most websites : the lack of optimization of the robots.txt file (also called the robots exclusion protocol or standard).

This text file is part of every website on the Internet, designed to work with search engines. By optimizing your robots.txt the right way, you can tell search engine bots to spend their crawl budgets wisely. And that’s what makes the robots.txt file so useful in an SEO context.

Better Robots.txt features:

  • It enables (or not) 16 most popular search engine bots to crawl your website
  • Detects your Sitemap index (sitemap-index.xml) from Yoast SEO plugin and adds it automatically to your Robots.txt file
  • It allows the addition of your own Sitemap
  • It allows the edition of your robots.txt in order to add custom rules
  • It allows the setup of a global crawl-delay for search engine bots
  • It blocks bad bots from crawling your website
  • It blocks most SEO crawlers in order to make backlinks undetectable.

Better Robots.txt plugin will also add standard rules in your robots.txt file to maximize search engines’ crawl budgets by telling them not to crawl the parts of your site that aren’t displayed (by default) to the public.

Better Robots.txt Pro

Want to become familiar with some syntax used in a robots.txt file. Basic robots.txt guidelines by Google.

[Total: 4    Average: 5/5]