FAQ: The venv Died. Five State Myths Agents Repeat

Описание и применение

Пробники в локальной, агентской и CI средах выявляют несоответствия, позволяя разработчикам доверять только проверенным действиям.

Задача

Agents claim to install packages, set env vars, persist files, run tests, or store secrets, but CI fails due to missing imports or state inconsistencies.

Результат

Consistent probing across environments exposes state mismatches, enabling developers to trust only verified actions and maintain reliable CI pipelines.

Рабочий процесс

• Copy probe scripts to scripts/agent_probes
• Run probes locally and save to probes/local.txt
• Run probes on the agent box and save to probes/box.txt
• Run probes in CI and save to probes/ci.txt
• Diff the three probe outputs and base decisions on the diff

Доказательства

Run the same probe in three places. That means local shell, agent box, then CI.

Источник

If the three fingerprints differ, I stop trusting the transcript.

Источник