I made CodeRabbit's reviews a third less noisy with an open-source Claude Code skill

说明与用途

pr-proof 是一个开源的 Claude Code 技能，验证每条代码评审评论，减少 34% 噪声并将 CodeRabbit 的 F1 分数提升至 40.4%。

问题

AI code review bots generate many noisy comments that developers skim, causing real bugs to slip through.

结果

pr-proof achieved a 93.5% retention of real bugs, removed 34% of noise issues, and raised CodeRabbit’s F1 score by 5.2 points (95% CI +1.9 to +8.3).

工作流

• Install pr-proof via Claude Code plugin marketplace
• Run pr-proof on a PR to validate each review comment
• pr-proof reads the full file, traces execution, checks against conventions and docs
• It returns a verdict (valid, partly valid, wrong, style) citing file and line
• After all comments are verified, pr-proof applies approved fixes and replies on threads

证据

On a public benchmark of 50 real pull requests, CodeRabbit raised 300 issues. 77 of them were real bugs on the benchmark's list. Most of the rest were noise: things that look like problems but aren't once you read the code.

来源

kept 72 of the 77 real bugs (93.5%)

来源

removed 76 of the 223 noise issues (34%)

来源

raised CodeRabbit's F1 score from 35.2% to 40.4% (+5.2 points, 95% CI +1.9 to +8.3)

来源