A Run Manifest for AI Email Automation

说明与用途

为 AI 电子邮件验证创建运行清单的指南，定义唯一运行 ID、邮箱租约、原子消息声明和预算限制，以降低 CI 测试的偶发性。

问题

Email verification tests are flaky because mailbox state, message timing, and tool usage are hidden in prompts and temporary variables, making failures hard to reproduce and debug.

结果

Implementing a run manifest reduces flaky email verification tests, provides clear failure diagnostics, and enables consistent CI behavior across parallel jobs.

工作流

• Create lease with unique run_id and mailbox address
• Send verification request to service
• Poll inbox within deadline until message matches expected sender and subject
• Atomically claim the message
• Verify token from message
• Release mailbox lease
• Publish redacted receipt as CI artifact

证据

An AI agent can create a test account, request a verification message, and report success in a single conversation.

来源

Without a manifest, the setup are often hidden in prompt text and temporary variables.

来源

The manifest is not a prompt. The runtime should enforce it even when an agent asks for another poll.

来源

Publish a redacted receipt as an artifact

来源