I gave a 10-line agent a CRM world and asked it for one number
说明与用途
使用 Silo 在 CRM 模拟环境中测试简单代理:从安装到调试错误并获得正确结果。
问题
Test an AI agent’s ability to perform a sales operation in a realistic CRM environment and debug failures deterministically.
结果
Agent achieved 100% score on weighted pipeline task after a two‑line fix, demonstrating deterministic evaluation and clear debugging path.
工作流
- Install Silo and init CRM demo
- Run agent on TASK-004
- Inspect result.json, trace.jsonl, state-diff.json
- Identify bug in callTool response handling
- Fix agent code
- Re‑run and observe PASS
证据
The reported weighted total is correct.
Task TASK-004 - Report the weighted value of open pipeline Result PASS Reward 1.00
- 记录日期: 2026-09-21T19:45:11.769Z