ThinkJev: One Thought, Every Budget for Calibrated Typed Decisions
Many uses of language models end in a typed decision: a choice among a closed set of options, whose probabilities code can act on. Reading those probabilities from one forward pass is fast but often wrong on decisions that take several steps, such as arithmetic, counting, and date comparison.
arXiv - cs.AI3 min read