StableMRR
Crawler

StableMRRBot

The user agent we use when we read a pricing page.

Our crawler identifies itself as StableMRRBot/1.0 (+https://stablemrr.com/bot; [email protected]). It reads the public home page and pricing page of a product, and only after a person approved the listing, to build its directory entry.

  • It obeys robots.txt, including rules written for StableMRRBot.
  • It sends at most one request every couple of seconds to a site, and about one visit per week.
  • It stops when a site answers with an error such as 403 or 429, or shows a bot check, and does not try another route.
  • It stores plan names, prices and feature labels, the product name, a short summary, the logo and the main colour, not the page text.

Opt out

To stop the crawler, disallow StableMRRBot in your robots.txt. To remove your product's page, write to [email protected] from an address at your domain or contact us; we remove it within 48 hours. If the crawler causes a problem, write to the same address and we stop it at once.