Crawler
StableMRRBot
The user agent we use when we read a pricing page.
Our crawler identifies itself as StableMRRBot/1.0 (+https://stablemrr.com/bot; [email protected]). It reads the public home page and pricing page of a product, and only after a person approved the listing, to build its directory entry.
- It obeys robots.txt, including rules written for
StableMRRBot. - It sends at most one request every couple of seconds to a site, and about one visit per week.
- It stops when a site answers with an error such as 403 or 429, or shows a bot check, and does not try another route.
- It stores plan names, prices and feature labels, the product name, a short summary, the logo and the main colour, not the page text.
Opt out
To stop the crawler, disallow StableMRRBot in your robots.txt. To remove your product's page, write to [email protected] from an address at your domain or contact us; we remove it within 48 hours. If the crawler causes a problem, write to the same address and we stop it at once.