Qwen 3.6 preserve_thinking flag fails in oMLX

// 45d agoINFRASTRUCTURE

Qwen 3.6 preserve_thinking flag fails in oMLX

A developer reports the preserve_thinking kwarg for Qwen 3.6 is non-functional in oMLX, preventing visibility into the model's reasoning process. The issue persists even when manually editing the configuration file, despite the model's Jinja template explicitly supporting the feature.

// ANALYSIS

This highlights a common friction point in local LLM deployment: feature mismatches between model templates and inference runner implementations.

–The `preserve_thinking` feature is critical for observability into reasoning models; its failure limits utility for developers tracking model logic
–The user correctly identified `chat_template_kwargs` in the configuration file, suggesting the issue lies in how oMLX parses or passes these arguments
–The Jinja template clearly includes the logic, pointing to a potential bug or missing feature in oMLX's handling of quantized Qwen models

// TAGS

omlxqweninferencellmopen-source

DISCOVERED

45d ago

2026-04-22

PUBLISHED

45d ago

2026-04-22

RELEVANCE

6/ 10

AUTHOR

Longjumping-Sweet818

// KEEP READING

More AI developer news from the feed

EXPLORE FULL FEED

UPDATE29m ago

Antigravity CLI updates add LaTeX and model selection

Three releases for the Antigravity CLI were rolled out in the past week, delivering numerous quality-of-life improvements based on user feedback. The updates include support for LaTeX math equations, the introduction of a new --model flag along with the agy models command, and a new /permissions command for managing permissions.

OPEN SOURCE35m ago

A new collection of 205 ready-to-run AI agent templates has been released for the OpenClaw ecosystem.

Awesome OpenClaw Agents is a newly released collection featuring 205 ready-to-run AI agent templates designed for the OpenClaw ecosystem. The agents are packaged as simple copy-paste SOUL.md files and span 24 categories including DevOps, Legal, Healthcare, and E-Commerce. To ensure a seamless setup experience, each template comes complete with a Dockerfile, docker-compose configuration, a bot, and a detailed README.

UPDATE43m ago

Mint.gg remasters 2D games into 3D worlds

Developer Tamrat Alemu showcased a demo for Mint.gg that converts classic 2D game environments, such as Pokémon Ruby, into interactive 3D worlds. The platform enables users to compose assets generated by various AI models with physics, multiplayer, and spatial audio directly on the web.