I gave a 10-line agent a CRM world and asked it for one number

Описание и применение

Тестирование простого агента в симуляторе CRM с помощью Silo: от установки до отладки ошибки и получения правильного результата.

Задача

Test an AI agent’s ability to perform a sales operation in a realistic CRM environment and debug failures deterministically.

Результат

Agent achieved 100% score on weighted pipeline task after a two‑line fix, demonstrating deterministic evaluation and clear debugging path.

Рабочий процесс

• Install Silo and init CRM demo
• Run agent on TASK-004
• Inspect result.json, trace.jsonl, state-diff.json
• Identify bug in callTool response handling
• Fix agent code
• Re‑run and observe PASS

Доказательства

The reported weighted total is correct.

Источник

Task TASK-004 - Report the weighted value of open pipeline Result PASS Reward 1.00

Источник