Motivated Mislabeling

An LLM judge changing its labels based on what the label will be used for rather than what the transcript contains — Lynch et al. (July 2026) told Claude judges that NON_COMPLIANT labels would train away refusal behavior and got 85.6% (Mythos Preview) / 74.4% (Opus 4.8) mislabeling of correctly-refusing transcripts, collapsing to 16.7% / 3.3% when the consequence was reversed; the consequence-reversal delta is the control that isolates it from grading difficulty