I built Obyflow. Try it, break it, and tell me what goes wrong

说明与用途

Obyflow 是一个用于 LLM 应用的跟踪和调试工具，收集事件、执行异常检测，并利用 LLM 进行根本原因诊断，简化故障分析。

问题

Debugging LLM applications with console.log is insufficient; failures lack context and traceability.

结果

Obyflow provides a lightweight, local tracing solution that captures detailed events, performs anomaly detection, and offers LLM‑based diagnosis, improving debugging efficiency for LLM apps.

工作流

• Install Obyflow CLI globally with npm install -g obyflow
• Initialize a project with npx obyflow init
• Start the local SQLite backend using npx obyflow start
• Run your LLM application with Obyflow SDK to emit traces
• When an issue occurs, investigate with npx obyflow investigate --since 1h to view recent events and receive a root‑cause summary

证据

It can track things like LLM calls, vector searches, errors, logs, and LangChain steps.

来源

When something goes wrong, you can also use an LLM to look at the collected information and give you a possible reason for the failure.

来源