Replayable Automation Needs Better Run Receipts

说明与用途

通过紧凑的 JSON 收据捕获身份、输入、决策、尝试、证据和清理，使自动化更透明、更易调试，快速定位并重现失败。

问题

Automation failures are hard to diagnose because run logs lack concise, actionable context, making it difficult to understand why a job failed or how to reproduce the issue.

结果

Automations become more transparent and debuggable; developers can quickly locate a run, understand every decision, and replay the scenario with controlled fixtures, reducing mystery and improving reliability.

工作流

• 1. Execute automation job with unique run ID and commit SHA.
• 2. Capture safe inputs (feature flags, endpoint names).
• 3. Log decisions (continue, retry, stop) and attempt details (start/end time, status, correlation ID).
• 4. Record evidence (response status, headers, redacted IDs).
• 5. Note cleanup actions (data removed or left).
• 6. Store the receipt as a JSON artifact in CI logs.
• 7. Use the receipt to replay decisions with safe fixtures and compare outcomes.

证据

A receipt turns an automation run from a single outcome into something a developer can replay and understand.

来源

Start with one JSON file per run. Add richer tracing only when the receipt shows a real gap.

来源