A PR Review Gate That Fails Closed: Free Models in CI

说明与用途

一个在发现 BLOCK 时关闭的 PR 审核门，使用免费 AI 模型对差异进行分类并运行测试，自动阻止合并，适用于小型开源项目。

问题

Reviewers are rarely tested, leading to bugs slipping through; free AI models can hallucinate and block good code, so a deterministic gate that fails closed is needed.

结果

The gate blocks merges when the model flags BLOCK findings, allows merges when only ASK or NIT findings are present, and logs the review for human inspection.

工作流

• Extract the diff with gh pr diff and git diff --stat
• Run the test suite and capture output
• Generate a structured review prompt from diff, stats, and test log
• Send prompt to a free model (e.g., MonkeyCode) and parse output
• Fail the gate if any BLOCK findings are present

证据

Free models hallucinate. They praise broken code. They block good code.

来源

The gate runs four steps. Each step writes a file. Each file feeds the next step.

来源