agent-desktop 1.1.0 Controls macOS System UI
agent-desktop 1.1.0 expands AI agents’ native macOS reach to the Dock, menu bar, and Control Center. The open-source computer-use CLI also improves ref stability after UI changes and adds visible, steady-paced typing.
This is a meaningful step from app automation toward dependable desktop automation, where system-level surfaces are often the hardest and most privileged targets.
- –Dock, menu bar, and Control Center access covers workflows that ordinary app-scoped automation cannot reach.
- –Stable element refs reduce accidental actions against the wrong control when interfaces re-render or shift.
- –Visible caret movement and paced typing make agent actions easier to audit and more compatible with fragile native inputs.
- –The accessibility-tree approach is more deterministic than screenshot-only coordinate clicking, but still depends on macOS permissions and accessible UI semantics.
- –Developers should treat this as infrastructure for computer-use agents, not a standalone agent or model.
DISCOVERED
1h ago
2026-11-03
PUBLISHED
1h ago
2026-11-03
RELEVANCE
AUTHOR
mdlahfir