Break It on Purpose
Описание и применение
Система Night Watch и Day Shift автоматически обнаружила и исправила ошибку в поисковой строке, сократив время реакции до 31 минуты и уменьшив количество уведомлений до двух писем.
Задача
A staging site search box crashed due to a deliberately introduced bug that skipped archived clients, causing undefined property errors.
Результат
The self‑healing loop resolved the bug in 31 min, costing $2.45 in agent credit, and reduced alert noise from 16 to 2 emails per drill.
Рабочий процесс
- Night Watch monitors logs and opens incidents
- Night Watch triages incident and asks AI for fix
- Day Shift receives request and writes spec
- Spec writer reviews and sends back note
- Spec approved by human gate
- Day Shift builds, tests, and deploys fix
- Incident closed after replay confirms healing
Доказательства
At 17:45 on October 24, 2026, the search box on our staging site started to crash. We had put the bug there on purpose: one line in a database read skipped archived clients, so a search that found their entries failed with Cannot read properties of undefined (reading 'name')
Forty‑two seconds after the first error, a fix request was waiting in our pipeline. Thirty‑one minutes after the first error, a pull request was ready for review: a one‑line fix, and a test that proves it.
Two small services do the work. Night Watch watches the site's logs and checks, opens incidents, asks an AI to triage them, and alerts by email, Telegram and Slack. Day Shift turns a request into a reviewed pull request: it writes a spec, builds in its own workspace, runs the project's checks, has a second agent review the change, and deploys to staging.
The bug drill cost $2.45 of agent credit and took 31 minutes from the first error to a pull request.
- Дата записи: 2026-10-25T01:11:44.778Z