Bugs Are Innocent Until Reproduced: Building Verdict, an Evidence-First Agent Harness

说明与用途

Verdict 将 bug 报告转化为可验证的调查，收集观察结果，并仅在证据达到确定性阈值时给出结论。

问题

Flaky bug reports often end as "cannot reproduce" or patches that cannot be proven fixed, leaving maintainers uncertain about the true state of a bug.

结果

Verdict successfully reproduced TrueForge issue #417, producing a deterministic verdict and a reproducible evidence record that can be recomputed by anyone.

工作流

• Create a GitHub issue for the bug
• Hunter searches the approved condition matrix and runs the command under budgeted conditions
• Surgeon narrows the reproduced condition to the smallest suspect range supported by evidence
• Insurance converts the reproduction into a regression plan (test name, fixture, failing assertion, publication manifest)
• Maintainer reviews the evidence and approves the draft pull request
• Verified reproduction is published with a nonce-bound workflow
• Recompute evidence locally with pnpm --filter @verdict/agent verify:runtime-evidence

证据

Verdict turns a GitHub issue into a bounded investigation. It runs an approved command repeatedly under approved conditions, keeps every observation and refuses to claim a reproduction unless the evidence crosses a deterministic threshold.

来源

Verdict reproduced TrueForge issue #417, where snapshot registration can wait indefinitely when an upstream request never resolves.

来源