QuietfetchBot

What this bot is, what it does on your site, and how to turn it away.

Quietfetch publishes data-collection tools (“actors”) on the Apify platform. When one of our customers runs a tool against a page, the request identifies itself with this user agent:

Mozilla/5.0 (compatible; QuietfetchBot/0.1; +https://quietfetch.com/bots; contact: [email protected])

What it does

• Public pages only. It fetches pages that need no login. It never signs in, never stores cookies or sessions, and never fetches anything behind a paywall or account.
• robots.txt first. Before the first request to a site it reads /robots.txt and obeys the rules for QuietfetchBot (or * if there are none). Disallowed paths are skipped, not retried.
• Slow by design. At most one request per second to any one site, two per second in total, one connection at a time. These ceilings are in the code and cannot be raised by a customer.
• No evasion. No proxy rotation, no browser-fingerprint spoofing, no CAPTCHA solving. If your site blocks the bot, the run fails visibly — it does not route around the block.
• What it keeps. Only what the page shows publicly (for example plan names and list prices on a pricing page). Our tools do not collect personal data for resale.

How to opt out

1. In robots.txt — takes effect on the bot’s next visit:

User-agent: QuietfetchBot
Disallow: /

2. By email — write to [email protected] with your domain. We add it to a block list that is built into every tool we publish; after that the tools refuse to fetch your domain and its subdomains no matter what a customer asks. We confirm by reply, and the change ships in the next release of each tool, normally within 14 days. You do not need to give a reason.

Something else?

If the bot is doing anything this page does not describe, please tell us at [email protected] with the timestamp and your server’s log line — that is a bug and we will fix it.