Reference-Free Judge Over-Crediting

Reference answers are a first-order determinant of LLM-judge verdicts: without one, judges systematically over-credit wrong answers (up to 85% verdict flips when the reference is added — Kranti & Vajjala), and self-play against a reference-free judge inflates pass rate at flat true accuracy (Zhou); the fix is the judge committing its own answer first.