Distil Labs open-sources trace-to-SLM pipeline

This is the most practical version of the small-model thesis: stop asking giant generalists to do repetitive routing work they were never specialized for.

• –The real trick is not just distillation but using real production traces as domain context, which makes the synthetic training set look like live traffic instead of benchmark fluff
• –dlt, Hugging Face, and Distil Labs form a clean handoff from data extraction to training to deployment, so the workflow feels portable rather than locked into one stack
• –The headline number is impressive because it uses exact structured match for function calls, which is the metric that actually matters in agent pipelines
• –A 79.5% exact-match score still means plenty of failures, so serious deployments need confidence thresholds and fallback routing to a larger model
• –If this pattern generalizes beyond smart-home routing, it weakens the assumption that every agent step needs a frontier API call