Give Your AI Agent Hands: Android Automation via MCP

Описание и применение

Сервер MCP app-automating позволяет ИИ управлять Android‑устройствами, выполнять UI‑операции и запоминать пути навигации, упрощая тестирование, скрапинг и автоматизацию.

Задача

AI agents need hands‑on control over Android devices for testing, scraping, bug reproduction, exploration, and repetitive tasks, but existing tools lack device lifecycle management, screen interaction, and memory of navigation paths.

Результат

The app-automating MCP server enables AI agents to fully control Android devices, perform UI interactions, and remember navigation paths, streamlining testing, scraping, bug reproduction, exploration, and repetitive automation tasks.

Рабочий процесс

• 1. Start the MCP server using FastMCP.
• 2. Use the android_ tools to create, boot, rename, stop, or delete AVDs and download system images.
• 3. Deploy the target app to the emulator or physical device.
• 4. Employ appium_ tools to tap, type, swipe, scroll, press keys, take screenshots, and read the view hierarchy.
• 5. Record interactions automatically with navigation_memory_ tools to build a navigation graph.
• 6. Replay recorded routes for bug reproduction or automated chores.
• 7. Iterate exploration to map unfamiliar apps and update the navigation memory.

Доказательства

app-automating is an open-source MCP server that gives an AI agent real control over Android — emulators and physical devices alike.

Источник

It does three things: Manages the AVD environment, Drives the screen, Remembers how it got there.

Источник

28 tools, three modules: android_ (10) for the device lifecycle, appium_ (13) for the screen, navigation_memory_ (5) for the map.

Источник