I analyzed 12,000 ready‑made web scrapers. 1 in 10 popular ones fails more than 10% of the time
Описание и применение
ScraperWatch использует реальные данные о работе 12 000 веб‑скреперов из Apify Store, чтобы ежедневно обновлять рейтинги по количеству запусков, проценту успешных запусков и стоимости. Это позволяет пользователям выбирать надёжные и экономичные инструменты, избегая скреперов с низкой популярностью и высокой частотой ошибок.
Задача
Choosing a reliable web scraper from the Apify Store is difficult because ratings are sparse and often misleading.
Результат
Among established tools, 9.4% fail more than 10% of runs; reliable tools vary widely in price; 68% of tools have fewer than 10 users, while the top 1% capture 71% of users.
Рабочий процесс
- 1. Pull Apify Store API data for all ~12,000 tools. 2. Aggregate 240 million runs from the last 30 days. 3. Filter for established tools (300+ runs, 20+ users/month). 4. Calculate failure rates and price per 1,000 results. 5. Publish per‑site pages ranked by real usage, success rate, price, and last run. 6. Offer extras: best picks, rising tools, open data, MCP server, and reliability badges.
Доказательства
240 million runs in the last 30 days; 1.2% failed or timed out overall.
Among established tools (300+ runs and 20+ users a month), 129 of 1,375 (9.4%) fail more than 10% of their runs.
Equally reliable tools differ in price by orders of magnitude. Among Amazon scrapers that succeed at least 95% of the time, the median costs $2.00 per 1,000 results and the most expensive costs $100.
68% of tools had fewer than 10 users last month, while the top 1% got 71% of all users.
- Дата записи: 2026-10-18T13:56:31.562Z