Googly Eyes Turns iPhone Into AI Cursor
Riley Brown’s open-source Googly Eyes—called Bluey in the post—pairs an iPhone character with a Mac menu-bar app to inspect, point at, and control the desktop. It uses OpenAI’s gpt-realtime-2.1 for voice context, plus Vision and accessibility tools for computer interaction. [GitHub](https://github.com/rbrown101010/bluey-by-riley)
This is the kind of delightfully weird prototype frontier models make cheap: not another chatbot, but a voice agent with a physical interface and permissioned access to your computer.
- –The iPhone becomes a dedicated voice-and-feedback surface while the Mac handles screen capture, tool execution, and secure session setup.
- –Screen understanding, cursor pointing, clicking, typing, and app launching make the agent feel embodied rather than conversational.
- –Built-in confirmations, blocked password fields, and an emergency stop are essential safeguards for computer-use agents.
- –The project demonstrates a practical architecture for low-latency voice agents using OpenAI’s Realtime API and WebSocket sessions. [OpenAI documentation](https://developers.openai.com/api/docs/models/gpt-realtime-2.1)
DISCOVERED
1h ago
2026-10-03
PUBLISHED
1h ago
2026-10-02
RELEVANCE
AUTHOR
rileybrown