1-bit Bonsai 8B hits 250 t/s benchmark

Extreme 1-bit quantization is moving rapidly from academic theory to blistering, practical speed.

• –Hitting 250+ t/s for generation and 9000+ t/s for prompt processing proves the immense compute efficiency of 1-bit architectures in llama.cpp.
• –Compressing an 8B parameter model to ~1.1GB means powerful local LLMs can now easily fit in RAM on standard consumer hardware, smartphones, and edge devices.
• –If the quality degradation of Q1_0 quantization remains acceptable for specific tasks, 1-bit models like Bonsai-8B will become the default for on-device reasoning.