I analyzed 12,000 ready‑made web scrapers. 1 in 10 popular ones fails more than 10% of the time
Description and use
ScraperWatch leverages real usage data from 12,000 Apify Store scrapers to provide daily rankings by run count, success rate, and price, helping users pick reliable and cost‑effective tools while avoiding low‑usage, high‑failure scrapers.
Problem
Choosing a reliable web scraper from the Apify Store is difficult because ratings are sparse and often misleading.
Outcome
Among established tools, 9.4% fail more than 10% of runs; reliable tools vary widely in price; 68% of tools have fewer than 10 users, while the top 1% capture 71% of users.
Workflow
- 1. Pull Apify Store API data for all ~12,000 tools. 2. Aggregate 240 million runs from the last 30 days. 3. Filter for established tools (300+ runs, 20+ users/month). 4. Calculate failure rates and price per 1,000 results. 5. Publish per‑site pages ranked by real usage, success rate, price, and last run. 6. Offer extras: best picks, rising tools, open data, MCP server, and reliability badges.
Evidence
240 million runs in the last 30 days; 1.2% failed or timed out overall.
Among established tools (300+ runs and 20+ users a month), 129 of 1,375 (9.4%) fail more than 10% of their runs.
Equally reliable tools differ in price by orders of magnitude. Among Amazon scrapers that succeed at least 95% of the time, the median costs $2.00 per 1,000 results and the most expensive costs $100.
68% of tools had fewer than 10 users last month, while the top 1% got 71% of all users.
- Record date: 2026-10-18T13:56:31.562Z