Qwen3.5-397B-A17B tops local LLM benchmark tests

Massive MoE models like Qwen 3.5 397B are redrawing the boundaries for local AI, proving that frontier-class intelligence is no longer restricted to multi-GPU data centers.

• –High efficiency: 17B active parameters deliver intelligence comparable to top-tier proprietary models while maintaining a manageable compute footprint.
• –Hardware threshold: Q8_0 quantization requires nearly 400GB of RAM, making the 512GB Mac Studio the only consumer device capable of hosting the model at high precision.
• –Optimization breakthroughs: Jangq.ai's "mixed-precision" quantization prevents the coherence failures seen in standard 2-bit quants for large MoE architectures.
• –Performance bottleneck: While the model fits in unified memory, the 800GB/s throughput of the M3 Ultra limits tokens-per-second, favoring deep reasoning over real-time chat.
• –Ecosystem growth: The success of vMLX and MLX Studio suggests a maturing software stack for high-end local LLM inference on macOS.