Anthropic, AE Studio introduce GRAM
Anthropic and AE Studio have published research on Gradient-Routed Auxiliary Modules (GRAM), a pretraining method that isolates sensitive dual-use knowledge into toggleable neural compartments. By freezing general weights and updating only designated modules during domain training, developers can control access to specific capabilities without degrading overall model performance.
GRAM solves the massive cost barrier of safety-filtering, but its success hinges on whether highly complex dual-use capabilities can truly be cleanly isolated from general reasoning.
* Technical isolation: Unlike post-training unlearning or behavioral guardrails, GRAM isolates sensitive information structurally during pretraining, rendering it much harder to bypass or fine-tune back into the model.
* Compute efficiency: Instead of training separate filtered models for different compliance and deployment environments, a single training run produces a model customizable for sixteen distinct access profiles.
* Potential limitations: Entangled knowledge—where general logic is deeply integrated with sensitive domain context—remains a major open challenge that might limit clean separation in scale.
DISCOVERED
1d ago
2026-07-09
PUBLISHED
1d ago
2026-07-08
RELEVANCE
AUTHOR
AnthropicAI