Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

My Agent Gave a Refund on Day 47. My Policy Said 30. The Culprit Was 900 Words Down My Prompt.

说明与用途

退款系统因系统提示中冲突的指令而在30天后错误处理退款。通过重新排序规则、澄清语气和缩短提示长度,合规率提升至94%。

问题

Refunds were incorrectly processed beyond the 30‑day policy due to conflicting instructions in a long system prompt.

结果

Prompt reordering, tone clarification, and length reduction increased refund compliance from 23% to 94% for day‑47 cases, reducing policy violations and associated costs.

工作流

  • 1. Identify conflicting refund instructions in the system prompt.
  • 2. Reorder prompt so the policy rule is last.
  • 3. Clarify tone guidance to avoid overriding policy.
  • 4. Reduce prompt length to avoid dilution of specificity.
  • 5. Add structured decision output to enable measurement.
  • 6. Run automated tests (20 runs per case) to evaluate compliance.
  • 7. Adjust prompt based on results.
  • 8. Deploy updated prompt to production.

证据

Line 203 beat line 41. By 160 lines and a lot of confident phrasing.

来源

Identical text, three orderings, same 30 cases: Bottom of prompt 94%

来源

Length diluted specificity, badly. 1,410 words 18% compliance

来源

  • 记录日期: 2026-11-01T02:58:55.466Z