Mining PR Review Comments to Surface Team’s Unwritten Code‑Review Rules

Описание и применение

Инструмент PR Rulebook анализирует комментарии к PR‑ам, выявляя повторяющиеся правила ревью, которые не задокументированы, и выдаёт их с оценкой достоверности.

Задача

Teams often have implicit code‑review conventions that are never documented, making it hard for new members and automated tools to enforce consistent standards.

Результат

The pilot run on 15 merged PRs from ruff yielded 45 review comments and two candidate rules, revealing limitations in the initial clustering logic and leading to improved evidence filtering across multiple PRs.

Рабочий процесс

• Clone the PR Rulebook repo
• Install dependencies and build the CLI
• Set a read‑only GitHub token
• Run the CLI against a target repo for the last 6 months
• Review the generated REVIEW_RULES.md for candidate rules and evidence

Доказательства

The v0 clustering emitted two candidate rules.

Источник

The fix now requires evidence across at least two distinct PRs.

Источник