The data nobody sells: why I started taking a daily snapshot of 211,243 companies
Описание и применение
Система ежедневного снимка статуса компаний, использующая открытый API налоговой службы Южной Кореи, позволяет собирать историю изменений статуса, что невозможно сделать только с текущими данными.
Задача
The Korea National Tax Service API provides only current company status, lacking historical data, making it impossible to track changes over time.
Результат
After three days, the system recorded 70 and then 94 changes out of 211,243 observations, confirming that 99.96% of records remained unchanged while 0.04% captured meaningful status transitions.
Рабочий процесс
- 1. Schedule a daily job to query the API for each company in a fixed list.
- 2. Store the returned status with timestamps.
- 3. Diff today’s data against yesterday’s data.
- 4. Write a separate file containing only the records that changed.
- 5. Monitor and validate the diff output for correctness.
Доказательства
Korea's National Tax Service runs a clean public API for business registration status. Give it a 10-digit number, get back whether the company is active, suspended or closed.
Ask it today and you learn the company is closed. Ask what it was last month and there's no answer, because that question isn't in the API.
A scheduled job, running once a day, that asks for the current status of every company in a fixed list and stores the answer. Then it diffs today against yesterday and writes a separate file containing only what changed.
Three days in, the numbers look like this: Day 1 211,243 — (first run, everything is new) Day 2 211,243 70 Day 3 211,243 94
A company that was operating when I looked on the 29th had closed by the 30th. I can't prove when it actually closed — only when I observed each state.
The job that ran nothing and exited 0. I wrote about this one in the last post: an entry-point guard that compared hand-built file URLs, worked on Windows, silently failed on Linux.
- Дата записи: 2026-10-23T02:26:22.352Z