A specialized web agent scored 41.7 on WebRetriever while GPT and Claude failed the same form-filling task

说明与用途

专用代理 Mano‑CUA 在 WebRetriever 上获得 41.7 分，优于 GPT 和 Claude，擅长复杂网页表单填写和导航。它采用视觉感知和 think‑act‑verify 循环，完全在 Apple silicon 本地运行。

问题

General-purpose LLMs struggle with complex browser automation tasks such as multi-step form filling, dropdown selection, and navigation through paginated results.

结果

Mano-CUA achieved a 41.7 NavEval score on WebRetriever Protocol I, surpassing Gemini 2.5 Pro (40.9) and Claude 4.5 (31.3). It reliably handles multi-step form filling, dropdowns, and dynamic page changes through a vision‑driven think‑act‑verify loop.

工作流

• Install Mano-CUA via Homebrew on Apple silicon
• Run the CLI with the --local flag to keep all data on-device
• Provide a natural language instruction (e.g., "fill out the application form on example.com")
• The agent captures screenshots, identifies clickable elements visually, and executes actions
• After each action it verifies the result from the new screenshot and retries if necessary

证据

Mano-CUA 1.1 scored 41.7 NavEval. Gemini 2.5 Pro Computer Use got 40.9. Claude 4.5 Computer Use landed at 31.3.

来源

The 4B quantized model runs on Apple M5 Pro hardware at about 80 tokens per second decode speed.

来源

Mano-CUA’s think‑act‑verify loop forces it to check whether each action actually worked before moving to the next step.

来源