Why Our CLI Deadlock Detector for Multi-Agent LLMs Timed Out: A Post-Mortem on Naive Jaccard Heuristics

说明与用途

多代理LLM死锁检测CLI工具在高并发测试中因O(N²)相似度计算和简单分词导致超时，未能满足10秒SLA。

问题

The Asynchronous Semantic Deadlock Checker failed to complete within the required 10‑second SLA during high‑concurrency QA stress tests involving more than 20 active agents.

结果

The tool collapsed under high concurrency, failing to meet the 10‑second SLA, highlighting the inefficiency of naive tokenization and pairwise similarity for large agent sets.

工作流

• 1. Read JSON array of agent logs from stdin
• 2. Tokenize each agent’s output using naive whitespace splitting
• 3. Build a pairwise Jaccard similarity matrix (O(N²))
• 4. Flag pairs with similarity below 0.15 as divergent
• 5. Identify the agent with the highest outlier distance
• 6. Emit a JSON diagnostic payload to stdout

证据

The goal was simple: consume execution traces, calculate semantic alignment across all collaborating agents, and trigger recovery interventions within a strict 10-second SLA.

来源

During high-concurrency QA stress tests involving 20+ active agents, the tool collapsed with an unhandled timeout.

来源