Your scraper says SUCCEEDED but the data is empty: three ways to catch it

说明与用途

Scraper 运行成功但数据为空的情况。文章提供三种检测方法：启用 Apify 免费监控、将最新运行与历史中位数比较、使用现成的 Actors 进行完整性检查。

问题

Scraper runs report success while output data is empty or incomplete, causing undetected failures.

结果

By enabling free monitoring, comparing runs to historical medians, and using ready‑made Actors, silent scraper failures are detected early, reducing data quality issues.

工作流

• 1. Enable Apify’s free Monitoring tab for each Actor or task, setting alerts on result-count thresholds and run status.
• 2. If fixed thresholds are insufficient, run a Node.js script that compares the latest run to the median of recent successful runs, sampling the first 200 items and checking field completeness.
• 3. Optionally use third‑party Actors such as Output Completeness Monitor, Dataset Drift Monitor, or the author’s Scraper Output Guard for ready‑made checks.

证据

Each Actor or task has a Monitoring tab. You can set alerts on result-count thresholds and run status.

来源

The guide on GitHub has a small Node.js script that does this with three API calls (list runs, get dataset metadata, fetch the first 200 items).

来源

There are third-party Actors with similar checks, such as Output Completeness Monitor and Dataset Drift Monitor.

来源