From prose to assertions: making 'done' checkable when an AI agent writes the code

说明与用途

在验收标准中引入机器可检查的断言消除了审查的主观性，使 CI 能自动验证结果并捕获分歧。

问题

After an AI agent claims "done", the review process remains subjective and trustable only by human auditors, leading to inconsistent verdicts and non‑machine‑readable reports.

结果

The updated workflow increased test coverage from 49 to 55, all passing, and introduced automated recomputation of audit verdicts, turning subjective disagreements into resolvable numeric checks.

工作流

• Define acceptance criteria with optional assertion JSON objects.
• Freeze the acceptance pack in DwGuard-Dsh-Hmos.
• Run adversarial pre‑review and DevEco Code in Goal mode.
• Audit delivery: gather evidence, record actual values, recompute assertion verdicts.
• Generate structured audit reports (markdown and JSON) with assertion, actual, and verdict columns.
• CI consumes audit‑<n>.json to enforce gate logic.
• Handle gate outcomes: error, warning, or pass based on assertion results.
• Iterate on criteria or measurements if mismatches occur.
• Maintain human‑only judgments for non‑measurable aspects.

证据

The audit side then must report an actual value next to the verdict:

来源

The change shipped as 0.5.0 and the suite went from 49 to 55 tests, all green

来源

An optional field that nobody enforces is decoration. So the gate has opinions

来源