Bespoke Labs drops Bespoke-Nimble-9B for structured decisions
Bespoke Labs has released Bespoke-Nimble-9B, an open-weight LoRA adapter fine-tuned on Qwen3.5-9B to enable rapid, context-grounded structured prediction for developer agents. Instead of generating verbose text, Nimble-9B restricts outputs to pre-enumerated values by scoring token probabilities directly from logits, achieving approximately 90% accuracy on Jev-style benchmarks under an Apache 2.0 license.
The AI industry's obsession with massive generative reasoning models overlooks the fact that most production agent steps are just structured decision trees, where a fast, logit-scored 9B model dramatically outperforms frontier models in latency, cost, and reliability.
- –Direct logit scoring on allowed token choices eliminates decoding overhead, stream parsing errors, and hallucinated schemas.
- –The 165 MiB LoRA adapter footprint allows teams to run deterministic classification locally or co-host multiple task adapters on a single Qwen3.5 base model.
- –Training via contrastive data curation demonstrates how synthetic perturbations can harden decision boundaries against subtle context distractors.
- –Provides an open-weight, privacy-preserving alternative to specialized closed decision models like Jev for high-throughput enterprise pipelines.
DISCOVERED
1h ago
2026-09-20
PUBLISHED
1h ago
2026-09-20
RELEVANCE
AUTHOR
AI Search
