Huihui Adds Ternary Qwen Abliteration Variant
Huihui-AI added an experimental ternary series derived from PrismML’s Ternary Bonsai 2 27B, applying ablation to layers 22–52. The model offers compact 6.6–7.7 GB variants, but remains a test release requiring PrismML’s llama.cpp fork.
This is more valuable as a local-model experiment than as a polished drop-in checkpoint.
- –Combines refusal ablation with ternary quantization, making quality and safety tradeoffs difficult to predict.
- –PTQ1_0 and PQ2_0 files make a 27B model unusually accessible on consumer hardware.
- –Stock llama.cpp cannot run the ternary files; developers need PrismML’s custom runtime.
- –The untouched layers, modified ablation range, and quantization changes create a useful benchmark target against both parent models.
- –Huihui-AI explicitly frames the series as testing and validation, so production use deserves caution.
DISCOVERED
1h ago
2026-10-06
PUBLISHED
2h ago
2026-10-06
RELEVANCE
AUTHOR
Oluwaphilemon1