Qwen tool calls trip Continue

// 45d agoINFRASTRUCTURE

Qwen tool calls trip Continue

A LocalLLaMA user reports that Qwen3.5-9B runs through Lemonade in VS Code and responds normally in Continue.dev, but fails at tool calling and behaves erratically in Roo Code and Kilo Code. The likely issue is not raw model capability, but mismatched tool-call formatting and parser support between Qwen-style XML/tool templates, Lemonade’s serving layer, and IDE agent clients.

// ANALYSIS

This is a useful reminder that “supports tool calling” is not a portable guarantee across local inference stacks; the model, chat template, server parser, and client all have to agree on the same protocol.

–Qwen3.5-9B advertises native function calling, but serving guides typically require a Qwen-aware parser or chat template rather than generic JSON-only tool handling
–Continue.dev detecting the model and producing text does not prove tool support is wired correctly through Lemonade’s OpenAI-compatible API surface
–Reports of hallucinated responses in Roo Code and Kilo Code point to a deeper prompt/template mismatch, not just one Continue configuration flag
–For local coding agents, model variants fine-tuned for tool use still need harness-level compatibility; QwenCode, Aider, OpenCode, or a server with explicit Qwen parser support may be more reliable
–The broader local-agent lesson is that small open models are getting capable enough, but tool-call interoperability remains brittle and under-documented

// TAGS

qwen3.5-9bqwencontinuelemonadellmai-codingagentinference

DISCOVERED

45d ago

2026-04-21

PUBLISHED

45d ago

2026-04-21

RELEVANCE

6/ 10

AUTHOR

baccanokozo

// KEEP READING

More AI developer news from the feed

EXPLORE FULL FEED

OPEN SOURCE1h ago

Felix Kjellberg (PewDiePie) has launched Odysseus, a privacy-first, local AI workspace designed to run entirely on user hardware as an open-source alternative to cloud services like ChatGPT.

Odysseus is a self-hosted, open-source AI productivity suite created by popular YouTuber PewDiePie (Felix Kjellberg). Designed to address privacy concerns associated with cloud-based AI providers, the workspace allows users to host local language models on their own hardware. It integrates chat features, autonomous agents with web-browsing capabilities, document editors, email management, and system-aware model recommendations, serving as a comprehensive local-first AI workspace.

UPDATE2h ago

Hermes Desktop adds Simplified Chinese support

Hermes Desktop, the cross-platform native application for running and managing Nous Research's open-source Hermes AI Agent, has released a complete localization update for Simplified Chinese. The update translates all user interface components including the chat window, sidebar, settings, command center, cron schedules, messages, user profiles, skills, and agents, making the local agent platform more accessible to Chinese-speaking users.

UPDATE3h ago

NVIDIA SkillSpector Secures Claude Code Templates

NVIDIA's open-source security scanner, SkillSpector, has been integrated into the Claude Code Templates repository to scan and protect new AI agent skill additions. SkillSpector detects potential vulnerabilities, prompt injections, and agentic risks by analyzing instruction sets and tool definitions prior to execution, ensuring that third-party contributions do not introduce malicious behaviors or security flaws into development environments.