Alibaba's OpenGCUA Opens Computer Use Stack
Alibaba's MAI-UI team released OpenGCUA, an Apache-2.0 stack that combines GUI actions with code execution, accessibility data, shell commands, and APIs. Its report claims a 19.6-point OSWorld-v2 improvement across eight models while reducing reported steps by 53%, alongside preliminary macOS and cross-device tooling.
OpenGCUA's important idea is architectural: computer use becomes a branching, feedback-driven program instead of a slow screenshot-click loop. The benchmark gains are promising, but the preview release and self-reported results need independent replication.
- –Code execution lets agents loop, branch, inspect intermediate results, and batch repetitive work.
- –Harness-to-model decision transfer gives models more control over when to observe and act.
- –Open trajectories across eight models create useful material for studying failure recovery and wasted steps.
- –The cross-device SDK connects computers, browsers, and phones, but remains preliminary and permission-heavy.
- –OpenGCUA wraps existing models rather than introducing a new one, potentially making cheaper models more practical for computer-use tasks.
DISCOVERED
1h ago
2026-10-16
PUBLISHED
1h ago
2026-10-16
RELEVANCE
AUTHOR
AIQuanting