YOU ARE VIEWING ONE ITEM FROM THE AICRIER FEED

SGLang-Omni 0.1.8 Brings Full-Duplex Serving

AICrier tracks AI developer news across Product Hunt, GitHub, Hacker News, YouTube, X, arXiv, and more. This page keeps the article you opened front and center while giving you a path into the live feed.

// WHAT AICRIER DOES

7+

TRACKED FEEDS

24/7

SCRAPED FEED

Short summaries, external links, screenshots, relevance scoring, tags, and featured picks for AI builders.

SGLang-Omni 0.1.8 Brings Full-Duplex Serving
OPEN LINK ↗
// 1h agoOPENSOURCE RELEASE

SGLang-Omni 0.1.8 Brings Full-Duplex Serving

SGLang-Omni 0.1.8 adds native full-duplex MiniCPM-o support and realtime serving for Nemotron VoiceChat. The open-source release includes 174 merged PRs, 19 new contributors, and 33 PRs from first-time contributors.

// ANALYSIS

This release pushes SGLang-Omni beyond conventional turn-based multimodal inference toward always-on voice interaction infrastructure.

  • –Native full-duplex support reduces the need for application-level turn-taking and interruption logic.
  • –Nemotron VoiceChat gains a practical realtime serving path for live speech-to-speech applications.
  • –Its multi-stage runtime and OpenAI-compatible APIs simplify deployment across encoders, thinkers, talkers, codecs, and vocoders.
  • –The contribution volume signals a rapidly expanding ecosystem around open audio and multimodal serving.
  • –Hardware requirements remain substantial for larger voice models, making optimization and resource-aware deployment essential.
// TAGS
sglang-omniinferencemultimodalspeechstreamingopen-source

DISCOVERED

1h ago

2026-10-12

PUBLISHED

1h ago

2026-10-12

RELEVANCE

9/ 10

AUTHOR

GenAI_is_real