Treat Model Comments as Named Hypotheses in an OSS Review

说明与用途

将 AI 集成到代码评审中，需要将其输出限制为可测试的假设，避免未验证的更改并加速人工监督。

问题

Chat‑authored model diffs introduce unverified changes, hidden helpers, and missing tests, causing reviewers to waste time proving patches are real and leading to stalled reviews.

结果

The workflow enforces that AI model contributions are hypothesis‑driven, testable, and confined to a small, allowlisted set of files, eliminating unverified changes and speeding human review.

工作流

• Detach at a recorded upstream SHA and record base SHA
• Pin the public issue URL and allowlist specific paths
• Write a failing test on the frozen SHA and record repro exit code
• Author minimal production edits by hand and record allowlisted diff
• Re‑run repro and smoke commands, recording exit codes
• Build a secret‑stripped review bundle and verify no credentials
• Ask the model for hypotheses only, writing output to hypotheses.md
• Accept, convert, or discard each hypothesis based on allowlist and testability
• Open the pull request with the contract, hypothesis log, and minimal changes

证据

Treat every model comment as a named hypothesis. Require a frozen path and a testable claim.

来源

The model never writes files in the working tree. The model never receives tokens or private mail.

来源