CICM exposes stale binding in LLMs
UC Berkeley researchers introduce CICM, a benchmark showing that LLMs can retain updated facts yet answer with outdated values because attention selects stale mentions. The paper proposes training-free attention redirection that corrects most tested errors.
This reframes context failure as a selection problem, not simply a memory or context-window problem.
- –Probes recover the current value in hidden states even when models output an old one.
- –Nearby repetitions of obsolete values can overpower newer assignments through attention drift.
- –CICM spans preference dialogues, changing constraints, and operational agent histories.
- –Attention interventions improve answers across Qwen, Llama, Mistral, and Gemma without retraining.
- –The results suggest agent systems need explicit state-selection safeguards, not just larger context windows.
DISCOVERED
1h ago
2026-10-02
PUBLISHED
1h ago
2026-10-02
RELEVANCE
AUTHOR
Discover AI