Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

I gave a 10-line agent a CRM world and asked it for one number

说明与用途

使用 Silo 在 CRM 模拟环境中测试简单代理:从安装到调试错误并获得正确结果。

问题

Test an AI agent’s ability to perform a sales operation in a realistic CRM environment and debug failures deterministically.

结果

Agent achieved 100% score on weighted pipeline task after a two‑line fix, demonstrating deterministic evaluation and clear debugging path.

工作流

  • Install Silo and init CRM demo
  • Run agent on TASK-004
  • Inspect result.json, trace.jsonl, state-diff.json
  • Identify bug in callTool response handling
  • Fix agent code
  • Re‑run and observe PASS

证据

The reported weighted total is correct.

来源

Task TASK-004 - Report the weighted value of open pipeline Result PASS Reward 1.00

来源

  • 记录日期: 2026-09-21T19:45:11.769Z