Tuning Jev, Part 3: Tuning Is Task-Specific, Four Places to Put Few-Shot Examples

Third in a series on tuning Jev as an LLM judge: Part 1 covered quality judging, Part 2 covered safety judging. Both found the same thing about few-shot: packing labeled exemplars into Jev’s state moved the model's output, sometimes won cleanly on a dev set, and never survived the held-out test…