I analyzed 12,000 ready‑made web scrapers. 1 in 10 popular ones fails more than 10% of the time
说明与用途
ScraperWatch 利用 Apify Store 12,000 个网页抓取工具的真实使用数据,提供每日更新的排名,按运行次数、成功率和价格排序,帮助用户挑选可靠且成本效益高的工具,避免低使用率和高失败率的抓取工具。
问题
Choosing a reliable web scraper from the Apify Store is difficult because ratings are sparse and often misleading.
结果
Among established tools, 9.4% fail more than 10% of runs; reliable tools vary widely in price; 68% of tools have fewer than 10 users, while the top 1% capture 71% of users.
工作流
- 1. Pull Apify Store API data for all ~12,000 tools. 2. Aggregate 240 million runs from the last 30 days. 3. Filter for established tools (300+ runs, 20+ users/month). 4. Calculate failure rates and price per 1,000 results. 5. Publish per‑site pages ranked by real usage, success rate, price, and last run. 6. Offer extras: best picks, rising tools, open data, MCP server, and reliability badges.
证据
240 million runs in the last 30 days; 1.2% failed or timed out overall.
Among established tools (300+ runs and 20+ users a month), 129 of 1,375 (9.4%) fail more than 10% of their runs.
Equally reliable tools differ in price by orders of magnitude. Among Amazon scrapers that succeed at least 95% of the time, the median costs $2.00 per 1,000 results and the most expensive costs $100.
68% of tools had fewer than 10 users last month, while the top 1% got 71% of all users.
- 记录日期: 2026-10-18T13:56:31.562Z