Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

I analyzed 12,000 ready‑made web scrapers. 1 in 10 popular ones fails more than 10% of the time

Description and use

ScraperWatch leverages real usage data from 12,000 Apify Store scrapers to provide daily rankings by run count, success rate, and price, helping users pick reliable and cost‑effective tools while avoiding low‑usage, high‑failure scrapers.

Problem

Choosing a reliable web scraper from the Apify Store is difficult because ratings are sparse and often misleading.

Outcome

Among established tools, 9.4% fail more than 10% of runs; reliable tools vary widely in price; 68% of tools have fewer than 10 users, while the top 1% capture 71% of users.

Workflow

  • 1. Pull Apify Store API data for all ~12,000 tools. 2. Aggregate 240 million runs from the last 30 days. 3. Filter for established tools (300+ runs, 20+ users/month). 4. Calculate failure rates and price per 1,000 results. 5. Publish per‑site pages ranked by real usage, success rate, price, and last run. 6. Offer extras: best picks, rising tools, open data, MCP server, and reliability badges.

Evidence

240 million runs in the last 30 days; 1.2% failed or timed out overall.

Source

Among established tools (300+ runs and 20+ users a month), 129 of 1,375 (9.4%) fail more than 10% of their runs.

Source

Equally reliable tools differ in price by orders of magnitude. Among Amazon scrapers that succeed at least 95% of the time, the median costs $2.00 per 1,000 results and the most expensive costs $100.

Source

68% of tools had fewer than 10 users last month, while the top 1% got 71% of all users.

Source

  • Record date: 2026-10-18T13:56:31.562Z