I built a 17-agent AI swarm on my phone — here's how

说明与用途

作者在 Pixel 7 上构建了一个 17 代理的 AI 群集，完全本地运行 TinyLlama 1.1B（4‑bit 量化），展示了边缘计算和多代理协作的可能性。

问题

Running a multi‑agent system entirely on a mobile device without cloud dependence, while managing limited CPU, memory, and prompt‑size constraints.

结果

The author successfully ran 17 cooperating LLM agents on a Pixel 7, demonstrating that local inference with a small quantized model can support a multi‑agent workflow, albeit with performance and memory trade‑offs.

工作流

• Select TinyLlama 1.1B and quantize to 4‑bit with llama.cpp
• Implement a lightweight Python agent framework with a shared blackboard
• Define 17 agent roles (Planner, Researcher, Summarizer, Critic, etc.)
• Write generate_prompt to tailor prompts per agent role
• Run agents in a loop: observe → think (LLM generate) → act (update blackboard)
• Optimize prompts for brevity and context window limits
• Manage memory aggressively to avoid OOM errors
• Log and debug interactions via Termux CLI

证据

I call it “IronVision Nexus”, and it currently runs 17 distinct agents, each with a specific role, all coordinating (or sometimes arguing) on my Pixel 7.

来源

TinyLlama 1.1B. This is key. While GPT‑3.5/4 would be better quality, they’re simply too large for practical on‑device inference.

来源

I quantized it to 4‑bit using llama.cpp to further reduce memory usage.

来源