Characterizing the role of reasoning tokens in large language models as state over tokens

Large language models increasingly rely on generating reasoning tokens that appear to describe a reasoning process performed by the model to arrive at the answer.