3.6 million checks of free proxy lists in a day: what the numbers show, and what they don't
说明与用途
文章介绍了 proxy‑scraper 工具,在一天内执行 360 万次公共代理列表检查。每次运行产生 126 万候选代理,只有 1.1% 通过所有三步验证。列表消失率分析显示大多数条目在一小时内消失,但少数条目可持续超过一天。
问题
Free proxy lists are often considered unreliable, but no quantitative data existed to confirm or refute this reputation.
结果
Out of 3.6 million checks, 93 244 answered the first request (2.6 % of checks), 50 193 failed the second request (54 % of those that answered), 2 244 had differing content (≥5.2 % of those that reached this step), and 40 807 proxies were kept (1.1 % of checks). List churn analysis shows that 85 % of entries that drop off the list do so within the next hour, but 215 entries remain for 24 runs or more.
工作流
- Collect 800 public proxy lists
- Generate ~1.26 million candidate proxies per run
- Prioritize 150 000 candidates based on previous success and list hit rate
- Perform first request to verify protocol and exit IP
- Perform second request to a second site and compare exit IP
- Request a static test page and compare hash
- Keep proxies that pass all three checks
- Record results in CSV and publish data
- Analyze funnel statistics and list churn over a week
证据
Each run reads about 800 public proxy lists and ends up with 1.26 million candidates on average.
24 runs × 150,000 = 3.6 million checks.
First request: the proxy speaks HTTP, SOCKS4 or SOCKS5 and returns a public exit IP from a check target – 93,244 answered (2.6 % of checks).
Second request: a request to a second site (httpbin.org) returns valid JSON with the same exit IP – 50,193 did not pass (54 % of those that answered).
Content: a static test page arrives byte for byte – 2,244 arrived with a different hash (at least 5.2 %).
Kept: the first two passed and the test page was not seen to differ – 40,807 (1.1 % of checks).
82 % of all entries are ports on 16 hosts, each with 50 or more entries.
85 % were gone by the very next check, an hour later.
- 记录日期: 2026-10-16T22:41:26.305Z