My Agent Gave a Refund on Day 47. My Policy Said 30. The Culprit Was 900 Words Down My Prompt.
说明与用途
退款系统因系统提示中冲突的指令而在30天后错误处理退款。通过重新排序规则、澄清语气和缩短提示长度,合规率提升至94%。
问题
Refunds were incorrectly processed beyond the 30‑day policy due to conflicting instructions in a long system prompt.
结果
Prompt reordering, tone clarification, and length reduction increased refund compliance from 23% to 94% for day‑47 cases, reducing policy violations and associated costs.
工作流
- 1. Identify conflicting refund instructions in the system prompt.
- 2. Reorder prompt so the policy rule is last.
- 3. Clarify tone guidance to avoid overriding policy.
- 4. Reduce prompt length to avoid dilution of specificity.
- 5. Add structured decision output to enable measurement.
- 6. Run automated tests (20 runs per case) to evaluate compliance.
- 7. Adjust prompt based on results.
- 8. Deploy updated prompt to production.
证据
Line 203 beat line 41. By 160 lines and a lot of confident phrasing.
Identical text, three orderings, same 30 cases: Bottom of prompt 94%
Length diluted specificity, badly. 1,410 words 18% compliance
- 记录日期: 2026-11-01T02:58:55.466Z