Your AI Patch Is Cheap to Write and Expensive to Review: A 90-Minute Review-Cost Ledger
说明与用途
问题:AI补丁降低编码成本,但增加人工审查时间。解决方案:使用 review_ledger.py 进行 90 分钟的快速实验,测量审查时间并与人工补丁比较。
问题
AI-generated patches reduce coding effort but increase human review time, making software still expensive.
结果
The spike produced a lightweight, stdlib‑only tool that measures whether AI patches increase review time beyond a 50% median increase compared to hand‑written patches.
工作流
- Write hypothesis and kill rule (0–10 min)
- Build ledger script review_ledger.py (10–25 min)
- Run five fixed tasks and generate patches (25–60 min)
- Time each review and record minutes (60–80 min)
- Compute median review minutes, compare ratio, and produce verdict (80–90 min)
证据
Agent patches that pass CI cost no more human review minutes than hand‑written patches touching the same files.
Three numbers, not a dashboard
The spike is not about which model is best. It is about whether your review loop absorbs the output at a sane price.
- 记录日期: 2026-10-26T13:11:11.575Z