I gave a 10-line agent a CRM world and asked it for one number

Description and use

Testing a simple agent in a CRM simulation with Silo: from setup to debugging a bug and achieving the correct result.

Problem

Test an AI agent’s ability to perform a sales operation in a realistic CRM environment and debug failures deterministically.

Outcome

Agent achieved 100% score on weighted pipeline task after a two‑line fix, demonstrating deterministic evaluation and clear debugging path.

Workflow

• Install Silo and init CRM demo
• Run agent on TASK-004
• Inspect result.json, trace.jsonl, state-diff.json
• Identify bug in callTool response handling
• Fix agent code
• Re‑run and observe PASS

Evidence

The reported weighted total is correct.

Source

Task TASK-004 - Report the weighted value of open pipeline Result PASS Reward 1.00

Source