33 broken builds, one agent on each disposable computer. The hard part was deciding what counts as fixed

说明与用途

在一次黑客松中，33个项目构建失败。自动代理修复了其中17个，平均更改4行代码，并将机器冻结并附上详细说明供团队使用。

问题

Hackathon submissions often fail to build end‑to‑end; teams receive only a score, not actionable debugging information.

结果

The agent fixed 17 of 33 broken builds with an average of 4 source lines changed, costing ~$7 in model time per machine and ~$16 total.

工作流

• 1. Rewind frozen machine to failure point
• 2. Install coding agent on machine
• 3. Provide agent with failure command, last 40 output lines, and instructions
• 4. Agent attempts minimal change to make command exit 0
• 5. Harness reruns command to verify success
• 6. If successful, agent writes FIX.md and machine is frozen again

证据

17 of 33 now build.

来源

The median fix was 4 lines.

来源

All 33 machines cost about $7 in model time.

来源