The Stop List for Free Inference and Free Hosts

Описание и применение

Команда создала документ «stop list», который связывает бесплатные зависимости с сигналами риска и предопределёнными действиями. Используя JSON‑ledger, линтер и «detach drill», они получили повторяемый процесс принятия решения об отказе от бесплатных сервисов.

Задача

Teams adopt free inference endpoints or servers without clear criteria for when to abandon them, leading to hidden risks beyond cost.

Результат

Teams gain a repeatable, low‑overhead process to evaluate and exit free inference dependencies, reducing hidden operational risk.

Рабочий процесс

• Define a capability ledger JSON per job listing endpoint, capabilities, latency, fallback, and owner.
• Lint the ledger with a CI pre‑merge check that flags red‑line capabilities such as "mutates_durable_state".
• Run a detach drill by pointing provider base URLs to a port that refuses connections and compare job behavior to the normal run.
• If the job fails or behaves unexpectedly, decide to add a second writer or mark the job as an accepted exception.
• Maintain an exit‑criteria table to record agreed actions for each risk signal.
• Use the stop list to allow on‑call engineers to execute the exit decision at any time without committee.

Доказательства

A stop list fixes this. It is a short document, dated, that pairs each free dependency with an observable signal and a pre‑agreed action.

Источник

Running it against the sample above exits 1 with one line naming the durable write.

Источник

Exit criteria are worthless if nobody can measure the exit. The drill runs one command twice: once normally, once with every provider base URL pointed at a port that refuses connections.

Источник