OrcaRouter LFM3-1.7B-abliterated Slashes Refusals
OrcaRouter’s refusal-reduced derivative of Liquid AI’s 1.73B LFM3 model reports average harmful-prompt refusals falling from 87.3% to 2.8%, while retaining its 256K context and local-agent focus. The underlying LFM3 model is designed for roughly 1GB 4-bit deployment, but this repository currently ships only larger BF16 safetensors.
This is a striking demonstration of how cheaply safety behavior can be edited out, but “uncensored” should not be confused with capability preservation or production readiness.
- –The reported refusal scores come from a rule-based classifier, not an LLM judge, so they measure surface refusal behavior more than robust safety or intelligence.
- –Capability retention is mixed: GSM8K stayed flat, while MMLU and MMLU-Pro declined; long-context, tool-use, and agent performance were not independently evaluated for this derivative.
- –The 1GB phone story belongs to 4-bit LFM3 deployments; this repository is approximately 3.4GB in BF16 and has no GGUF files, so mobile users need a separate quantization and runtime path.
- –Abliteration is attractive for red-teaming and interpretability research because it edits weights without retraining, but removing refusals also removes an important deployment boundary.
- –Developers should add their own moderation, permission controls, and abuse monitoring before exposing the model to tools or real-world actions.
DISCOVERED
1h ago
2026-11-04
PUBLISHED
2h ago
2026-11-04
RELEVANCE
AUTHOR
0x0SojalSec
