The Model-Change Protocol: What I Actually Do When the Tally Shows Two Weeks of Model Drift

Описание и применение

Протокол из пяти шагов позволяет выявлять и устранять дрейф модели, избегая ненужных смен моделей и настройки параметров.

Задача

Two consecutive weeks of model-tag growth indicated a model problem, but prior investigations had misattributed drift to model changes instead of prompt edits.

Результат

The protocol resolved the drift without swapping models, saved ~2.5 hours, updated the contract by one line, re‑baselined two fixtures, and established a revisit schedule.

Рабочий процесс

• Declare a model incident and freeze version bumps
• Run the golden fixture suite against both behaviors
• Diff the divergences, not the averages
• Take one of three decisions (pin, adopt, quarantine)
• Log the decision with an expiry date

Доказательства

The protocol exists to make sure I never do that again.

Источник

Step 1 — Declare a model incident and freeze version bumps.

Источник

Step 2 — Run the golden fixture suite against both behaviors.

Источник

Step 3 — Diff the divergences, not the averages.

Источник

Step 4 — Take one of three decisions.

Источник

Step 5 — Log the decision with an expiry date.

Источник

Two weeks of tallies, one incident, one evening, 2.5 hours, one contract line, two fixtures re-baselined, zero model swaps.

Источник