I Built a Tool That Verifies What AI Agents Actually Did

Описание и применение

Matrix проверяет реальные действия AI‑агентов, сравнивая их отчёты с фактическими событиями в целевой системе (например, Gmail).

AI agents can claim to have performed actions that never occurred, leading to unreliable observability and trust issues.

Matrix enables objective verification of AI agent actions, reducing false positives and improving trust in agent-driven workflows.

1. Agent performs an action (e.g., sends an email).
2. Agent reports the action to the observability system.
3. Matrix receives the report and queries the target system (Gmail API).
4. Matrix evaluates the evidence and assigns a verdict: CONFIRMED, CONTRADICTED, or INCONCLUSIVE.
5. Matrix returns the verdict and evidence to the observability system for audit.
6. Users review the verification results to assess agent reliability.

AI agents can report success for actions that never happened.

Matrix checks the actual Gmail mailbox and returns: CONFIRMED — it happened, CONTRADICTED — it didn't, INCONCLUSIVE — there isn't enough evidence.