What to Trust, Revert, and Test in an Agent-Generated Pull Request

Описание и применение

Рабочий процесс выявляет и удаляет изменения вне области применения, добавляет контрактные и тесты отказа, снижая риск скрытых зависимостей.

Задача

Agent-generated PRs often modify unrelated files such as config, auth, or CI workflows, leading to scope creep and hidden dependencies.

Результат

The workflow isolates scope creep, ensures only relevant changes are reviewed, and enforces contract and failure tests, reducing risk of hidden dependencies.

Рабочий процесс

• Sort diff into Trust, Revert, Test buckets
• Run diff_scope.py to flag sensitive files
• Grep for exception handling and default changes
• Revert out-of-scope files and re-run CI
• Add contract test for happy path
• Add failure-injection test for error handling

Доказательства

CI is green. The diff also edits the shared config loader and one auth middleware file.

Источник

Green CI proves compilation, not intent

Источник

Step 1 — Sort the diff into three buckets

Источник

Run it against the PR branch: python diff_scope.py origin/main

Источник