Track new job openings at specific companies without scraping Indeed or LinkedIn

Описание и применение

Используя публичные JSON‑каналы ATS, можно получать актуальные вакансии без сложного скрапинга, а для масштабирования применить Apify‑актор, поддерживающий несколько систем.

Задача

Scraping job boards like Indeed or LinkedIn is hampered by Cloudflare challenges, logins, rate limits, and frequently changing HTML, leading to stale or reposted listings.

Результат

By using public ATS JSON feeds, the approach eliminates scraping hurdles, provides real‑time job data, and scales to thousands of companies with minimal maintenance.

Рабочий процесс

• Identify the ATS used by a company by inspecting the "Apply" link on its careers page.
• Determine the board slug from the URL and construct the public feed endpoint.
• Poll the feed, compare job IDs against a stored set of seen jobs, and output only new listings.
• Run the script via cron to receive daily alerts without browsers, proxies, or logins.
• For large scale, use the Apify actor "ATS Jobs Search" to query multiple ATSs with a single schema and only-new-jobs mode.

Доказательства

Scraping Indeed or LinkedIn Jobs looks like the obvious way to watch who's hiring. In practice you fight Cloudflare challenges, logins, rate limits and HTML that changes every few weeks, and the listings you do get are often days old, reposted from somewhere else.

Источник

That somewhere else is usually the company's own careers page, and most careers pages are powered by an applicant tracking system (ATS) that publishes a clean, public JSON feed.

Источник

Run it from cron once a day and you have a "new openings" alert for any list of companies, with no browser, proxies or logins.

Источник

We built ATS Jobs Search on Apify to solve. It covers seven ATSs (Greenhouse, Lever, Ashby, Workable, SmartRecruiters, Recruitee, Personio), uses one output schema, has a built-in directory of about 7,900 companies' boards, and has an "only new jobs since last run" mode.

Источник