The First Token Is Not the Verdict: Hidden Costs of Reading LLM Judges Without Generating

Reading an LLM judge's verdict from the logits of its first generated token is cheap, requires no generation, and is exactly what constrained decoding and likelihood-scoring evaluation harnesses produce.