Vercel AI Gateway adds WebSocket support for OpenAI Responses API
Vercel has introduced WebSocket mode support for the OpenAI Responses API on AI Gateway, enabling developers to maintain persistent connection states across conversational turns. By reducing overhead during multi-step tool calls, this update cuts end-to-end latency by roughly 40% for workflows with 20 or more tool executions, while fully supporting store=false and Zero Data Retention (ZDR) standards.
WebSocket mode is a substantial performance improvement for complex agentic workflows where traditional HTTP overhead compounds across multiple tool calls.
• Reduces end-to-end latency by approximately 40% when executing over 20 tool calls in a session.
• Eliminates repeated connection handshakes by keeping a single persistent connection open across turns.
• Maintains security compliance with support for store=false and Zero Data Retention (ZDR).
DISCOVERED
1h ago
2026-07-27
PUBLISHED
2h ago
2026-07-27
RELEVANCE
AUTHOR
vercel_dev