When Do LLMs Reason? A Dynamical Systems View via Entropy Phase Transitions

This research proposes that LLM reasoning is a dynamic decoding state, not a static property, observable through early-stage entropy dynamics during generation. Tasks benefiting from Chain-of-Thought exhibit consistent entropy reduction, interpreted as a phase-transition to a structured reasoning regime.