1-bit Bonsai LLMs require custom llama.cpp fork

1-bit quantization is the new frontier for on-device AI, delivering massive speed and power gains by ditching traditional precision. PrismML's models are the first commercially viable 1-bit LLMs to achieve parity with 8B-class models like Llama 3.1 and Qwen3. Performance of 44 tokens/second on iPhone 17 Pro Max makes real-time, offline reasoning viable for mobile applications. The current fragmentation of inference engines is a temporary barrier as 1-bit operations are upstreamed. Open-source Apache 2.0 licensing ensures these high-density models will likely become the standard for robotics and wearables.