The Receiving Inspection Workshop: A Gate for AI-Written Code

Описание и применение

Воркшоп создал «полку» для проверки кода, генерируемого ИИ, записывая JSON‑получение для каждого кандидата, чтобы гарантировать, что только проверенный код попадает в trunk.

Задача

AI‑written patches can be merged without explicit verification, leading to failures like a nightly seed job crash.

Результат

The workshop produced a gate that records a JSON receipt for each candidate, enabling traceability and preventing unverified code from merging.

Рабочий процесс

• Define invariant: nothing reaches trunk without a receipt
• Create fixture with three test cases for the task
• Build gate that parses, runs tests, records verdict, and stops
• Deliberately break gate to test quarantine logic
• Add property test to catch fake passes
• Yield accounting and transport swap to produce receipts.jsonl

Доказательства

Three agent‑written patches landed on a Friday afternoon. Two were nine‑line diffs, one touched a helper nobody remembered owning, and all three were reviewed in the ten minutes between a standup and a release.

Источник

A receipt is one JSON line. It names the task, the model that produced the candidate, the verdict, a machine‑readable reason, and a timestamp.

Источник