I Traced One Agent Question. The Trace Found Two Things I Forgot to Turn Off

Описание и применение

Снятие лишних сервисов (Code Interpreter и управляемой памяти) сократило время ответа агента с 8,5 с до 1,8 с, показывая, что избыточный контекст и дополнительные сервисы были основными источниками задержки.

Задача

Determine why an agent’s response time was high and identify unnecessary services contributing to latency.

Результат

Disabling Code Interpreter and memory reduced latency from 8.5 s to 1.8 s, showing that unnecessary services and excessive context caused most of the delay.

Рабочий процесс

• Enable all services (Gateway, Code Interpreter, memory) and run the question. Observe 8.5 s response time and 23 spans. Disable Code Interpreter and memory. Run the same question again. Observe 1.8 s response time and 11 spans. Compare token counts and span times to identify cost contributors.

Доказательства

My CloudOps agent answered a simple question in 8.5 seconds. After I switched off the services it did not need, the same question took 1.8 seconds.

Источник

The trace had 23 spans. The two model calls took about 6.9 seconds, roughly 81 percent of the request.

Источник

I removed Code Interpreter and memory, then asked the same question. The trace had 11 spans.

Источник

The answer was the plain health status: service, version, instance counts and no alarms.

Источник