AgentDecision-4B Makes Agent Loops 89% Cheaper
AgentDecision-4B is a LoRA-tuned Qwen3-4B adapter that handles bounded tool, argument, and completion choices inside agent harnesses, deferring uncertain states to larger language models. The paper reports 81.1–89.0% lower costs and up to 2.5× faster execution on familiar tasks, plus 91.5% success on shifted tasks. [Paper](https://arxiv.org/abs/2610.21412)
The compelling idea is not simply using a smaller model, but teaching it where agent trajectories actually go wrong and calibrating when it should hand control back to the LLM.
- –Post-mistake trajectory training targets the distribution shift that breaks many standalone tool-choice classifiers.
- –Per-choice confidence thresholds are essential: uncalibrated delegation reportedly reduced task success by 19 points.
- –The adapter handles bounded decisions efficiently while preserving frontier-model calls for planning, recovery, and difficult reasoning.
- –Results are promising but remain author-reported, and developers must recalibrate thresholds for their own harnesses and workloads.
- –The project points toward hybrid agent stacks where small local models manage routine control flow and large models handle semantic complexity. [Repository](https://github.com/JevAgentHarness/JevAgentHarness)
DISCOVERED
1h ago
2026-10-18
PUBLISHED
1h ago
2026-10-18
RELEVANCE
AUTHOR
Discover AI