Gemma 4 26B fails local function calls

// 45d agoMODEL RELEASE

Gemma 4 26B fails local function calls

Google's recently launched Gemma 4 26B Mixture-of-Experts (MoE) model is facing widespread reports of broken function calling and tool execution in local environments. Users transitioning from cloud-hosted versions to local inference via Ollama and llama.cpp report that the model frequently ignores tool-use commands and fails to maintain agentic reasoning loops despite its high benchmark rankings.

// ANALYSIS

Gemma 4's impressive 26B MoE architecture is a speed demon that currently lacks the local stability to handle complex agentic workflows.

–The 26B variant activates only 3.8B parameters per token, which likely contributes to reasoning brittle-ness when parsing complex tool schemas compared to the 31B dense variant.
–Critical bugs in early Ollama v0.20.x releases caused tool-call responses to be misrouted to reasoning fields, a major hurdle for initial local adoption.
–Formatting hallucinations, such as incorrect parameter names and abrupt generation ends, suggest that chat templates and quantizations for the new model are still maturing.
–While Gemma 4 scores 86.4% on function-calling benchmarks, the "last mile" of local implementation remains a significant friction point for developers building autonomous agents.

// TAGS

gemma-4llmai-codingagentmcpopen-sourceopen-weights

DISCOVERED

45d ago

2026-04-20

PUBLISHED

45d ago

2026-04-20

RELEVANCE

9/ 10

AUTHOR

bishwasbhn

// KEEP READING

More AI developer news from the feed

EXPLORE FULL FEED

UPDATE28m ago

Grok Imagine 1.5 adds dual-video generation

A user highlighted a helpful feature in xAI's Grok Imagine 1.5 video generator, where the tool sometimes outputs two different videos simultaneously. This dual-video generation lets users compare options side-by-side and select the best result for their needs.

NEWS33m ago

DeepSeek tops OpenRouter rankings four weeks straight

OpenRouter has reported that DeepSeek has sustained the number one position in its token share rankings for four weeks in a row. This milestone indicates a substantial and steady volume of developer traffic routing to DeepSeek models, highlighting their growing popularity and integration within the AI application ecosystem.

VIDEO40m ago

Google establishes Gemini as the model-layer foundation of a vertically integrated AI stack.

Google's flagship AI model family, Gemini, serves as the critical model-layer foundation of a vertically integrated AI stack that spans from custom TPU hardware to developer APIs and consumer-facing workflows. In the video, The PrimeTime analyzes Google's strategy to dominate the AI ecosystem by playing at all layers—hardware, models, developer tools, and consumer applications. This integration allows Google to optimize performance and cost efficiency, positioning them to capture maximum value across the AI value chain.