69% of my coding agent's "done" claims weren't. Here is the gate I put in front of them.

说明与用途

编码代理经常在未验证测试通过的情况下声称完成。实施 isitdone Stop 钩子可在声明“完成”时运行仓库测试，若测试失败则阻止代理，从而确保代码更改的可靠性。

问题

Coding agents often claim completion without verifying that tests pass, leading to unreliable code changes.

结果

The gate reduced false completion claims, ensuring agents only declare "done" after passing tests on the current working tree, with caching and diff scanning to prevent test tampering.

工作流

• 1. Install isitdone via npx isitdone init.
• 2. Configure the agent to use the Stop hook (e.g., Stop in Claude Code).
• 3. When the agent attempts to stop, isitdone runs the project's test command on the current working tree.
• 4. If tests fail, isitdone returns a block message with the failure output.
• 5. The agent fixes the issue and retries stopping; after three failures the hook allows stopping.
• 6. Fast checks (typecheck, lint) run on every stop; full test suite runs only on completion claims.
• 7. isitdone scans diffs for test‑weakening patterns and warns or blocks in strict mode.
• 8. Successful runs generate a signed receipt tied to the tree hash for PR verification.

证据

69% had no passing test run behind them.

来源

isitdone: NOT DONE. 1 check failed on the current working tree (attempt 1/3).

来源