Your agent waits a full second to send the number 3

Описание и применение

Jev ускоряет решения в агентских циклах, снижая задержку до 225 мс и стоимость до $0,018 за 1 000 оценок, сохраняя точность.

Задача

Agent loops waste time generating prose for simple decision steps, causing latency and cost inefficiencies.

Результат

Jev reduces decision latency by ~3× and cost by ~16× compared to properly constrained LLM calls, while maintaining comparable decision accuracy.

Рабочий процесс

• 1. Identify decision steps that require only a choice or yes/no.
• 2. Route those steps to Jev via jev-use plugin, passing the current state and typed question.
• 3. For steps that need text output, keep the LLM (e.g., Claude).
• 4. Handle Jev responses: if "escalate:true" forward to LLM; otherwise use the answer and confidence.
• 5. Continue the agent loop, using Jev for decisions and LLM for text generation.

Доказательства

Jev gets 86 decisions in 20 s; claude‑haiku‑4.5 gets 6 and gemini‑3‑flash 3 — all three called the way agent loops usually call them, which is the wrong way.

Источник

The honest latency lead is 3×, not 14×. What survives the fair fight is cost — 5× cheaper than the constrained Gemini call and 16× cheaper than the constrained Haiku one.

Источник