Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

3.6 million checks of free proxy lists in a day: what the numbers show, and what they don't

Описание и применение

В статье описывается автоматизированный скрипт proxy‑scraper, который в течение дня выполняет 3,6 млн проверок публичных списков прокси. Из 1,26 млн кандидатов в каждом запуске 150 тыс. проверяются, и только 1,1 % проходят все три этапа. Анализ показывает, что большинство записей исчезают в течение часа, но небольшая часть остаётся более суток.

Задача

Free proxy lists are often considered unreliable, but no quantitative data existed to confirm or refute this reputation.

Результат

Out of 3.6 million checks, 93 244 answered the first request (2.6 % of checks), 50 193 failed the second request (54 % of those that answered), 2 244 had differing content (≥5.2 % of those that reached this step), and 40 807 proxies were kept (1.1 % of checks). List churn analysis shows that 85 % of entries that drop off the list do so within the next hour, but 215 entries remain for 24 runs or more.

Рабочий процесс

  • Collect 800 public proxy lists
  • Generate ~1.26 million candidate proxies per run
  • Prioritize 150 000 candidates based on previous success and list hit rate
  • Perform first request to verify protocol and exit IP
  • Perform second request to a second site and compare exit IP
  • Request a static test page and compare hash
  • Keep proxies that pass all three checks
  • Record results in CSV and publish data
  • Analyze funnel statistics and list churn over a week

Доказательства

Each run reads about 800 public proxy lists and ends up with 1.26 million candidates on average.

Источник

24 runs × 150,000 = 3.6 million checks.

Источник

First request: the proxy speaks HTTP, SOCKS4 or SOCKS5 and returns a public exit IP from a check target – 93,244 answered (2.6 % of checks).

Источник

Second request: a request to a second site (httpbin.org) returns valid JSON with the same exit IP – 50,193 did not pass (54 % of those that answered).

Источник

Content: a static test page arrives byte for byte – 2,244 arrived with a different hash (at least 5.2 %).

Источник

Kept: the first two passed and the test page was not seen to differ – 40,807 (1.1 % of checks).

Источник

82 % of all entries are ports on 16 hosts, each with 50 or more entries.

Источник

85 % were gone by the very next check, an hour later.

Источник

  • Дата записи: 2026-10-16T22:41:26.305Z