I built Obyflow. Try it, break it, and tell me what goes wrong

Описание и применение

Obyflow – это инструмент для трассировки и отладки приложений LLM, который собирает события, выполняет аномалийный анализ и использует LLM для диагностики ошибок, облегчая поиск причин сбоев.

Задача

Debugging LLM applications with console.log is insufficient; failures lack context and traceability.

Результат

Obyflow provides a lightweight, local tracing solution that captures detailed events, performs anomaly detection, and offers LLM‑based diagnosis, improving debugging efficiency for LLM apps.

Рабочий процесс

• Install Obyflow CLI globally with npm install -g obyflow
• Initialize a project with npx obyflow init
• Start the local SQLite backend using npx obyflow start
• Run your LLM application with Obyflow SDK to emit traces
• When an issue occurs, investigate with npx obyflow investigate --since 1h to view recent events and receive a root‑cause summary

Доказательства

It can track things like LLM calls, vector searches, errors, logs, and LangChain steps.

Источник

When something goes wrong, you can also use an LLM to look at the collected information and give you a possible reason for the failure.

Источник