I built a 17-agent AI swarm on my phone — here's how

Описание и применение

Создана локальная многопользовательская система из 17 агентов на Android‑устройстве, использующая TinyLlama‑1.1B‑Chat‑v1.0, BabyAGI и SQLite для выполнения задач по резюмированию, проверке фактов и генерации контента без подключения к сети.

Задача

Running a multi‑agent system locally on a smartphone to avoid cloud dependence and preserve privacy.

Результат

The swarm can summarize articles, answer questions, and generate content locally, though it remains sluggish compared to cloud solutions.

Рабочий процесс

• 1. Quantize TinyLlama to 4‑bit with llama.cpp and load in Python.
• 2. Set up BabyAGI loop for task creation, prioritization, and execution.
• 3. Store agent memories, tasks, and results in SQLite for persistence.
• 4. Build a basic UI with Kivy and test via Termux on the phone.
• 5. Deploy 17 agents with specific roles (Task Master, Summarizer, Fact Checker, etc.).
• 6. Optimize performance by limiting context window and batching.
• 7. Implement garbage collection for SQLite to manage memory.
• 8. Refine prompts for each agent to ensure cooperation.

Доказательства

I opted for TinyLlama-1.1B-Chat-v1.0, a surprisingly capable 1.1 billion parameter LLM. It’s small enough to run reasonably well on a modern smartphone.

Источник

I chose BabyAGI. While simple, it provides a solid foundation for managing agent tasks and memory.

Источник

Instead of relying on a vector database like ChromaDB, I leveraged SQLite to store agent memories, tasks, and results.

Источник

I utilized termux on my phone for initial testing and debugging, accessing the Python environment via SSH.

Источник

The current system is functional, albeit a bit sluggish.

Источник