Modal Ships Moonshot Kimi K3 on Merge Gateway

// 2h agoINFRASTRUCTURE

Modal Ships Moonshot Kimi K3 on Merge Gateway

Modal has launched support for Moonshot AI's Kimi K3 on its Merge Gateway platform, integrated with Modal's custom DFlash speculative decoding architecture. The deployment reaches up to 460 tokens per second, offering a 360% increase in interactive speed and an 88% throughput boost on agentic workloads.

// ANALYSIS

Custom speculative decoding stacks are fast becoming the key performance differentiator for cloud infrastructure providers serving real-time AI agents.

* Ultra-Fast Inference: Achieving 460 tokens per second significantly reduces latency, enabling near-instantaneous feedback in conversational and interactive AI interfaces.

* Tailored for Agentic Workloads: An 88% increase in throughput directly addresses performance bottlenecks common in multi-turn, multi-step agent execution pipelines.

* Infrastructure Optimization: Proprietary hardware and speculative decoding tweaks allow Modal to extract maximum efficiency from model deployment without relying solely on raw compute scaling.

// TAGS

modalkimi-k3moonshot-aimerge-gatewayspeculative-decodingllm-inferencecloud-infrastructureagent

DISCOVERED

2h ago

2026-07-28

PUBLISHED

2h ago

2026-07-28

RELEVANCE

8/ 10

AUTHOR

merge_api

// KEEP READING

More AI developer news from the feed

EXPLORE FULL FEED

LAUNCH38m ago

Focusa launches mission control runtime for AI agents

Focusa (@focusa_dev) is an AI agent mission-control layer and Workpoint workflow runtime built by Verious Smith III to solve context loss and session failures in multi-step AI tasks. Unlike basic chat interfaces, Focusa maintains persistent session state, trajectory, evidence, and decisions across long-running agent workflows and model switches, providing AI operators with a durable, dependable environment for real-world automation.

UPDATE46m ago

Augment integrates Moonshot AI's Kimi K3 into Cosmos

Augment announced the integration of Moonshot AI's Kimi K3 open-source model into Cosmos, its agent orchestration platform. Highlighted by Augment as the most capable open-source model they have tested to date, Kimi K3 is now available within Cosmos to power developer agent workflows and multi-agent coordination.

UPDATE50m ago

Open Science v0.7.3 enhances long-running research workflows

AIPOCH has announced the release of Open Science version 0.7.3, an update focused on enabling complex and long-running AI research workflows. As AI agents move beyond short experiments toward extended research tasks, this release equips the workbench to handle larger scientific files, manage longer context demands, and provide a smoother workspace environment.