I Made My AI Agent Ask Permission Before Spending or Sending Anything. By Day 3 I Was Ready to Remove It.

说明与用途

开发者为 AI 代理构建了审批工作流，根据风险等级对操作进行分层，仅对高风险操作要求人工批准，从而降低错误和重复收费率。

问题

Agents performed risky actions (payments, emails, deployments) without human oversight, leading to duplicate charges and potential misuse.

结果

The redesigned approval system reduced daily approval requests from ~47 to ~6, eliminated duplicate charges, and prevented unauthorized actions while maintaining operational flow.

工作流

• Define risky tools and tiering logic based on tool and payload.
• When a risky tool is invoked, call request_approval to log the action and notify the owner.
• For Tier 1 actions, execute immediately without notification.
• For Tier 2 actions, enqueue the call with a 10‑minute delay and run a secondary LLM pass to flag potential issues; if flagged, promote to Tier 3.
• For Tier 3 actions, wait for human approval via a mobile interface; include a diff‑style summary and agent’s reasoning.
• Set a 4‑hour expiry on pending approvals that defaults to deny and triggers a customer follow‑up message.
• Batch Tier 3 approvals into a twice‑daily digest to reduce friction.
• Ensure the agent’s payload contains evidence (order ID, email thread, amount) to justify irreversible actions.
• Reject any Tier 3 action lacking verifiable evidence.
• Update the agent loop to handle approval responses and proceed accordingly.

证据

I had rebuilt the exact problem I was trying to solve — just with extra steps.

来源

The agent must argue its case. The approval payload includes the agent's reasoning and the specific evidence it used.

来源