Real-World Project: A Posting Collection & Analysis Agent from Start to Finish

说明与用途

一个自主代理每天抓取竞赛和资助公告，验证其开放状态、资格和条款安全性，记录失败，并生成简明摘要，帮助用户快速决策。

问题

Automatically collect contest and grant-program postings daily, filter risky clauses, and produce a one-page digest for quick morning review.

结果

The agent reliably collects and filters postings, logs failures, and provides a concise daily digest, enabling the user to focus on decision-making rather than data gathering.

工作流

• Define a single-sentence goal with completion criteria
• Measure site structure with curl and grep to identify real data points
• Create test fixtures from measured HTML fragments
• Write tests to enforce open status, deadline extraction, and other rules
• Implement collector modules with error handling and failure logging
• Add a terms filter using regex patterns to classify clauses
• Schedule the agent to run daily and generate a digest
• Audit outputs with an independent reviewer and adjust parsing logic
• Review the digest and decide on participation
• Iterate on parser and regexes for new sites or fields

证据

The first item in the list is an ad banner, so it always contaminates the parse

来源

Writing tests first narrows the AI's scope of work. Instead of "make something reasonably good," it becomes "make these tests pass."

来源

A system that only shows success counts cannot be trusted. Failures must appear on the same line for a human to believe it.

来源