I built a 17-agent AI swarm on my phone — here's how

说明与用途

在手机上完全本地运行的17个AI代理群，使用Godot、TinyLLM和ChromaDB实现推理与记忆。

问题

Run a swarm of 17 independent AI agents entirely on a mobile device without cloud inference, to explore edge AI and emergent behavior while preserving privacy.

结果

A 17‑agent swarm operates entirely on a smartphone, with local inference and memory, demonstrating feasible edge AI swarm behavior.

工作流

• 1. Chose Godot Engine as the runtime platform.
• 2. Implemented agents in GDScript, each with a unique prompt and role.
• 3. Integrated TinyLLM (1.3B 4‑bit quantized) for local language inference.
• 4. Set up a local Flask API to expose TinyLLM and ChromaDB services.
• 5. Each agent communicates with the Flask API over HTTP to query or update the vector database.
• 6. Agents loop through their tasks, exchanging observations, plans, and feedback.
• 7. The system runs continuously on the phone, demonstrating emergent swarm behavior.

证据

running a swarm of 17 independent AI agents entirely on my phone… everything is local, leveraging the surprisingly capable hardware we carry around in our pockets.

来源

TinyLLM is a quantized language model that can run on CPUs, even relatively low-powered ones. I’m using a 1.3B parameter model, quantized down to 4-bit, making it significantly smaller and faster.

来源

Each agent maintains a short-term memory using a local ChromaDB instance.

来源

The Flask server receives the questions, queries the ChromaDB vector database using TinyLLM for semantic similarity search, and returns the most relevant answer.

来源