I built Obyflow. Try it, break it, and tell me what goes wrong

Description and use

Obyflow is a tracing and debugging tool for LLM applications that captures events, performs anomaly detection, and uses LLMs for root‑cause diagnosis, simplifying failure analysis.

Problem

Debugging LLM applications with console.log is insufficient; failures lack context and traceability.

Outcome

Obyflow provides a lightweight, local tracing solution that captures detailed events, performs anomaly detection, and offers LLM‑based diagnosis, improving debugging efficiency for LLM apps.

Workflow

• Install Obyflow CLI globally with npm install -g obyflow
• Initialize a project with npx obyflow init
• Start the local SQLite backend using npx obyflow start
• Run your LLM application with Obyflow SDK to emit traces
• When an issue occurs, investigate with npx obyflow investigate --since 1h to view recent events and receive a root‑cause summary

Evidence

It can track things like LLM calls, vector searches, errors, logs, and LangChain steps.

Source

When something goes wrong, you can also use an LLM to look at the collected information and give you a possible reason for the failure.

Source