My AI Agent Remembered Staging. It Still Didn’t Know If It Was Healthy

Описание и применение

Эксперимент показал, что агент Bedrock может запоминать предпочтения пользователя, но не может считать их актуальными; для проверки состояния развертывания необходимо всегда обращаться к текущему источнику.

Задача

Determining whether an AI agent should rely on remembered preferences or always query a current source for deployment health.

Результат

The agent successfully remembered user preferences across sessions, but correctly identified that remembered data does not guarantee current health, enforcing a boundary between memory and real‑time evidence.

Рабочий процесс

• 1. Provide the agent with a read‑only deployment status tool via AgentCore Harness → AgentCore Gateway → Deployment_status Lambda.
• 2. Add AgentCore Memory with USER_PREFERENCE strategy to store preferred environment.
• 3. In a session, set preference: "My preferred environment is production."
• 4. Query deployment health; agent recalls preference, calls tool, returns fresh result.
• 5. Start a new session; observe delay before memory is available; after processing time, preference is recalled.
• 6. Use a different actor; confirm preference is actor‑specific.
• 7. Change preference to "staging"; observe that tool only supports production and agent correctly reports unknown health.
• 8. Conclude rule: use memory to decide what to look up, but always use a current source for truth.

Доказательства

The Lambda supported one environment: production. It returned a sample service version, instance count, alarms, health status, and a fresh observation time.

Источник

Long-term memory is not an immediate key-value write.

Источник

The agent remembered that I preferred staging, but it could not retrieve staging health. Instead of guessing, it said that the current health was unknown.

Источник