ActionOPD Distills Agent Decisions, Not Tokens
ActionOPD is a Tsinghua University method for distilling language-model agents at the semantic action level. It trains smaller models to match black-box teacher decisions on student-generated states without teacher token probabilities, shared tokenization, or copied reasoning traces.
ActionOPD targets a real weakness in conventional distillation: agents need to make the right tool-use decision, not reproduce identical wording. Its results are promising, but semantic agreement remains a proxy for correctness rather than a guarantee.
- –Uses on-policy student states, reducing train–inference distribution mismatch
- –Supports cross-family teacher–student pairs without tokenizer alignment
- –Improves four-benchmark averages by 3.3–6.9 percentage points
- –Open-source implementation includes training workflows for tool-use environments
- –Stronger single-trial results come with weaker repeated-success reliability than some baselines
DISCOVERED
1h ago
2026-10-16
PUBLISHED
1h ago
2026-10-16
RELEVANCE
AUTHOR
Discover AI