I built a 17-agent AI swarm on my phone — here's how

说明与用途

在 Pixel 7 Pro 上本地运行的 17 代理 AI 群集，使用 TinyLlama、BabyAGI、SQLite 和 Kivy，能够在无网络连接的情况下完成摘要、事实核查和内容生成。

问题

Running a multi‑agent system locally on a smartphone to avoid cloud dependence and preserve privacy.

结果

The swarm can summarize articles, answer questions, and generate content locally, though it remains sluggish compared to cloud solutions.

工作流

• 1. Quantize TinyLlama to 4‑bit with llama.cpp and load in Python.
• 2. Set up BabyAGI loop for task creation, prioritization, and execution.
• 3. Store agent memories, tasks, and results in SQLite for persistence.
• 4. Build a basic UI with Kivy and test via Termux on the phone.
• 5. Deploy 17 agents with specific roles (Task Master, Summarizer, Fact Checker, etc.).
• 6. Optimize performance by limiting context window and batching.
• 7. Implement garbage collection for SQLite to manage memory.
• 8. Refine prompts for each agent to ensure cooperation.

证据

I opted for TinyLlama-1.1B-Chat-v1.0, a surprisingly capable 1.1 billion parameter LLM. It’s small enough to run reasonably well on a modern smartphone.

来源

I chose BabyAGI. While simple, it provides a solid foundation for managing agent tasks and memory.

来源

Instead of relying on a vector database like ChromaDB, I leveraged SQLite to store agent memories, tasks, and results.

来源

I utilized termux on my phone for initial testing and debugging, accessing the Python environment via SSH.

来源

The current system is functional, albeit a bit sluggish.

来源