A PR Review Gate That Fails Closed: Free Models in CI

Описание и применение

Гейт для проверки PR, который закрывается при наличии блокирующих находок, использует бесплатные модели AI для классификации изменений и запускает тесты, обеспечивая автоматическую проверку без человеческого вмешательства.

Задача

Reviewers are rarely tested, leading to bugs slipping through; free AI models can hallucinate and block good code, so a deterministic gate that fails closed is needed.

Результат

The gate blocks merges when the model flags BLOCK findings, allows merges when only ASK or NIT findings are present, and logs the review for human inspection.

Рабочий процесс

• Extract the diff with gh pr diff and git diff --stat
• Run the test suite and capture output
• Generate a structured review prompt from diff, stats, and test log
• Send prompt to a free model (e.g., MonkeyCode) and parse output
• Fail the gate if any BLOCK findings are present

Доказательства

Free models hallucinate. They praise broken code. They block good code.

Источник

The gate runs four steps. Each step writes a file. Each file feeds the next step.

Источник