8 Frameworks in the Demo, 3 Rows in the Conformance Table: I Ran Microsoft's agent-hooks CTK

说明与用途

对 Microsoft agent‑hooks 与多种框架的兼容性测试显示，只有八个声称支持的框架中有三个真正支持；其余框架缺少适配器。CTK 运行快速，但因缺少 incremental_output 功能跳过四个向量，表明流式处理测试不完整。

问题

Determining which frameworks are truly supported by Microsoft’s agent‑hooks conformance kit and understanding gaps between demo claims and actual adapter availability.

结果

The CTK runs in 0.37 s, producing 73 vectors with 69 passes, 4 skips, and 0 failures. Skipped vectors are due to missing incremental_output capability, indicating untested streaming behavior. Only three frameworks have claim entries; six lack adapters, making them unsupported in the current SDK.

工作流

• 1. Install agent‑hooks SDK (e.g., agent-hooks-sdk==0.1.0b2).
• 2. Import CTK functions: from agent_hooks.ctk import load_vectors, run_vectors and ReferenceHarness from agent_hooks.ctk.reference.
• 3. Load vectors: vectors = load_vectors().
• 4. Run vectors: results = run_vectors(ReferenceHarness, vectors).
• 5. Inspect results: print(len(results), sum(r.status == "pass" for r in results)).
• 6. Review skipped vectors and reason field for capability gaps.
• 7. Compare results against the claim table in conformance/CLAIMS.md.
• 8. Verify adapter presence by grepping for framework names in the agent_hooks package.
• 9. If adapter missing, note that the framework is not yet supported.
• 10. Use findings to decide whether to adopt or request adapter integration.

证据

"produces the identical 20-row decision stream"

来源

On agent-hooks-sdk==0.1.0b2, Python 3.13, that's 73 vectors, 69 pass, 4 skip, 0 fail — in 0.37 seconds.

来源

The four skips are the interesting part, because they're not failures: ... missing capabilities: ["incremental_output"]

来源

Three rows. Six of the eight frameworks named in the launch post — LangGraph, the OpenAI Agents SDK, Semantic Kernel, LlamaIndex, CrewAI, the Claude Agent SDK — have nothing filed.

来源

If you want agent-hooks inside a LangGraph or OpenAI Agents SDK loop today, you write the adapter, because the four-method harness interface is the interface and nobody has written yours yet.

来源