llama.cpp WebUI adds native MCP client

// 73d agoPRODUCT UPDATE

llama.cpp WebUI adds native MCP client

llama.cpp's built-in `llama-server` WebUI now ships with a full MCP client, enabling local models to connect to external MCP servers and execute tool calls in an agentic loop. The feature, merged March 6 via PR #18655, also adds a `--webui-mcp-proxy` flag to handle browser CORS restrictions when connecting to remote MCP servers.

// ANALYSIS

Native MCP support in llama.cpp is a big deal — it brings the open-source local inference stack to parity with hosted AI tools that already lean heavily on MCP for agentic workflows.

–The WebUI can now connect to any MCP server, browse its resources, invoke its tools, and run multi-step agentic loops entirely on-device
–A `--webui-mcp-proxy` backend flag solves the browser CORS problem, a common pain point for web-based MCP clients
–Compatibility is model-dependent: models must support tool-calling schemas to participate; older or smaller models may silently skip the MCP context, which is already surfacing as a community pain point
–An active bug (issue #20475) means the CORS proxy breaks with `--api-key` set, causing 401 errors against auth-protected MCP servers
–A separate PR (#19373) to bring MCP support to `llama-cli` (the command-line interface) is still open, so the WebUI remains the only native entry point for now

// TAGS

llama.cppllmmcpopen-sourceagentinferenceself-hosted

DISCOVERED

73d ago

2026-03-15

PUBLISHED

73d ago

2026-03-15

RELEVANCE

8/ 10

AUTHOR

BeepBeeepBeep

// KEEP READING

More AI developer news from the feed

EXPLORE FULL FEED

UPDATE4h ago

Cursor adds dedicated subagents for skills

Cursor now allows developers to execute tool-heavy or research-intensive agent skills within dedicated subagents. This architectural shift isolates noisy background tasks, keeping the main chat context clean and focused.

UPDATE4h ago

YouTube moves AI labels to video player

YouTube is moving its AI content disclosures from video descriptions to more prominent placements beneath the player and on Shorts overlays. Starting in May, the platform will use internal signals to automatically label photorealistic AI content that creators fail to disclose.

OPEN SOURCE8h ago

Taste Skill kills AI "frontend slop"

Taste-Skill is an open-source framework that provides portable "agent skills" to enforce high-end design principles in AI-generated code. By injecting specific design directives and "anti-slop" rules, it enables LLMs to produce editorial-grade UIs that bypass generic, boilerplate-heavy AI templates.