Mobilerun Achieves 100% on AndroidWorld, Beating Google ARTEMIS

说明与用途

Mobilerun 在 AndroidWorld 基准测试中取得 100% 完全得分，超过 Google ARTEMIS，借助 mobile-harness 提供工具、应用卡和共享内存提升移动自动化效果。

问题

Achieving a perfect score on AndroidWorld benchmark for mobile AI agents.

结果

Mobilerun achieved a perfect 100% official score on AndroidWorld, outperforming Google ARTEMIS (99%+).

工作流

• Run AndroidWorld benchmark with mobile-harness
• Use mobile tools to interact with device
• Leverage app cards for structured app knowledge
• Utilize shared memory for recurring patterns
• Verify outcomes via accessibility info and screenshots
• Record interactions, screenshots, tool ops, judgments, timing

证据

Mobilerun just achieved a 100% official score on AndroidWorld, Google Research's benchmark for evaluating AI agents on Android.

来源

For our latest evaluation, we ran AndroidWorld using mobile-harness, our set of mobile tools and instructions for running mobile tasks through coding agents.

来源

The evaluation used: Tasks:116, Full scores:116, Official score:100%, Recorded interactions:1,419, Device:Pixel 6 emulator, OS:Android 13 / API 33, Model:gpt-6-astra / low.

来源

mobilerun / mobile-harness: 100%, Google ARTEMIS: 99%+

来源