Building a Lead Scanner to Filter Out Stale Freelance Jobs

说明与用途

一个自动化的职位扫描器，每小时抓取多个技术招聘板块，使用严格的最近时间窗口和正则表达式规则过滤掉过时或不需要的职位，只保留最新的自由职业机会，并存入本地 SQLite 数据库，方便快速查看。

问题

Finding solid freelance gigs required spending an hour or more each morning sifting through stale or irrelevant job board listings.

结果

The lead‑scanner reduces manual search time by filtering out stale and unwanted listings, yielding a concise daily queue of relevant freelance opportunities.

工作流

• 1. Hourly fetch of job board posts
• 2. Evaluate post timestamps against a strict recency window (12–24 h)
• 3. Normalize raw board data via board‑specific adapter modules into a standard schema
• 4. Apply deterministic exclusion rules using regex patterns on title and body
• 5. Store passing leads in a local SQLite database
• 6. View the cleaned queue through a simple local web interface

证据

I built a lightweight lead‑scanner that runs on my home automation server and checks a handful of tech‑focused boards every hour.

来源

Depending on the board's volume, my window is usually set between 12 and 24 hours.

来源

I use simple regular expression checks against the title and description body.

来源