Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

How to Collect Google News Results for Brand and Competitor Monitoring

Description and use

Automated collection of Google News results via Apify, structuring metadata, deduplicating URLs, and producing a daily digest workflow.

Problem

Need a structured daily news snapshot for brand and competitor monitoring without manual copying.

Outcome

Structured news metadata collected daily, deduplicated against baseline, enabling a reviewed digest workflow.

Workflow

  • 1. Choose a focused query (e.g., company name).
  • 2. Input JSON with queries, language, country, maxResults into Apify Actor.
  • 3. Run Actor, export Dataset (JSON/CSV/Excel).
  • 4. Inspect relevance of first results; adjust queries if needed.
  • 5. Optionally enable resolvePublisherUrls or includeFullText for enrichment.
  • 6. Download Dataset JSON as news.json.
  • 7. Run deduplication script to compare URLs with seen-news-urls.json and output new-news.json.
  • 8. Store baseline and new links for next run.
  • 9. Schedule bounded runs via Apify, store Dataset and diagnostics.
  • 10. Compare new links to baseline, group related stories, review summaries, and share digest.

Evidence

A daily news search becomes more useful when its results are structured. Instead of copying headlines into a spreadsheet, collect the headline, publisher, publication time and source link, then compare the new snapshot with yesterday's records.

Source

Set a small spending limit, run the Actor, and open the Dataset. The basic output includes title, publisherName, publishedAt, googleNewsUrl and the query and edition metadata.

Source

This script compares article links with a local baseline and writes new rows to new-news.json.

Source

Schedule a bounded run through Apify, store its Dataset and diagnostics, then compare the collected links with your baseline.

Source

  • Record date: 2026-10-23T00:26:24.506Z