Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

Fixing False Green Health Verdicts in Incident Agent

说明与用途

修复了一个错误,即当实时遥测数据不可用时,事故代理基于缓存的 Fivetran 证据报告“健康”状态。强制执行规则:“健康”状态需要实时证据确认。

问题

The incident investigation agent reported a pipeline as 'Healthy' based on cached Fivetran evidence when live telemetry was unavailable, leading to incorrect downstream investigation paths.

结果

Fixed a silent correctness bug where cached pipeline status incorrectly resulted in a 'Healthy' verdict. Implemented a strict invariant that 'Healthy' requires live evidence, preventing false positives in incident investigation.

工作流

  • Reproduce the false green verdict via /api/investigate endpoint.
  • Add custom Sentry span 'pipeline.decision' to capture runtime state (evidence mode, live status, MCP status, verdict).
  • Inspect Sentry trace to identify contradiction between non-live evidence and Healthy verdict.
  • Use Seer to analyze the failing trace and identify missing decision constraint (evidence currentness).
  • Verify hypothesis against source code: Healthy verdict should require live evidence, not just MCP success.
  • Implement fix in evaluateFivetranHealth helper to enforce hasLiveEvidence check.
  • Verify fix ensures cached evidence does not produce Healthy verdict.

证据

Current confidence requires current evidence.

来源

Healthy requires live evidence

来源

Pre-fix Sentry decision span showing cached Fivetran evidence, live evidence false, MCP unavailable, connected and on-schedule status, and a Healthy pipeline verdict

来源

  • 记录日期: 2026-09-07T00:21:33.468Z