DeepMind introduces SkillSmith to synthesize model weights natively
SkillSmith is a research framework that enables Large Language Models to process and synthesize model weights as a native input and output modality alongside text. By projecting prefix-tuning KV-cache weights into the latent space, it allows models to reason over existing capabilities and directly generate new task-specific weight adapters.
Treating model weights as a native LLM modality could fundamentally transform model customization by making weight synthesis as fluid as text generation. By unifying textual knowledge and parametric adapter weights into a single reasoning process, SkillSmith uses specialized KV adapters to ingest and emit prefix-tuning weights directly. This eliminates reliance on separate fine-tuning pipelines or manual weight-merging, laying the groundwork for autonomous, self-improving AI agents capable of synthesizing their own specialized skills.
DISCOVERED
1h ago
2026-08-02
PUBLISHED
1h ago
2026-08-02
RELEVANCE
AUTHOR
omarsar0