
Agent S4 evolves computer-use interfaces
Agent S4 is an open-source framework that autonomously designs and improves computer-use interfaces from task trajectories. Its evolved interfaces lifted Qwen3.8-27B’s OSWorld V2 score to 21.3%, 3.8× higher than fixed interfaces.
The paper’s key insight is that interface design—not just model scale or agent prompting—can become a learned capability.
- –A meta-agent builds and revises interface tools and usage knowledge without success labels.
- –Population-based evolution tests repositories on unseen validation tasks to favor generalization.
- –The system outperformed reported GPT-5.5 and Claude Opus 4.8 scores at substantially lower cost.
- –ScienceBoard performance improved from 41.4% to 58.6% with the same model.
- –Results remain benchmark-dependent, and a 21.3% OSWorld score shows computer use is still far from reliable.
DISCOVERED
1h ago
2026-10-21
PUBLISHED
1h ago
2026-10-21
RELEVANCE
AUTHOR
arnaudmercier