New Study Finds CoT Control Starts Early
This paper links weak chain-of-thought controllability to entropy collapse in the first few tokens after a reasoning trace begins. Prefilling tokens or banning common openings can improve compliance by 34–41 percentage points, especially for adding or restyling content.
The result complicates the reassuring idea that models simply cannot control their reasoning: some apparent limits may be decoding-start artifacts that inference-time interventions can unlock.
- –A single prefixed token can substantially increase controllability.
- –Banning frequent openings plus in-context examples produces the largest gains.
- –Addition and style control improve more reliably than suppression, suggesting distinct capabilities.
- –CoT-monitoring evaluations may underestimate models’ ability to reshape reasoning after the opening tokens.
- –The work does not demonstrate deliberate monitor evasion, so the safety implications remain suggestive rather than conclusive.
DISCOVERED
1h ago
2026-11-02
PUBLISHED
1h ago
2026-11-02
RELEVANCE
AUTHOR
omarsar0