A Run Manifest for AI Email Automation

Описание и применение

Руководство по созданию манифеста запуска для автоматизации проверки email с помощью ИИ, обеспечивающего уникальную идентификацию, аренду почтового ящика, атомарный захват сообщения и ограничение бюджета, что снижает непредсказуемость тестов.

Задача

Email verification tests are flaky because mailbox state, message timing, and tool usage are hidden in prompts and temporary variables, making failures hard to reproduce and debug.

Результат

Implementing a run manifest reduces flaky email verification tests, provides clear failure diagnostics, and enables consistent CI behavior across parallel jobs.

Рабочий процесс

• Create lease with unique run_id and mailbox address
• Send verification request to service
• Poll inbox within deadline until message matches expected sender and subject
• Atomically claim the message
• Verify token from message
• Release mailbox lease
• Publish redacted receipt as CI artifact

Доказательства

An AI agent can create a test account, request a verification message, and report success in a single conversation.

Источник

Without a manifest, the setup are often hidden in prompt text and temporary variables.

Источник

The manifest is not a prompt. The runtime should enforce it even when an agent asks for another poll.

Источник

Publish a redacted receipt as an artifact

Источник