Benchmark Contamination and Decontamination

Sun, Zhan & Gales (Cambridge): per-sample distribution distances expose that aggregate-accuracy decontamination can worsen residual contamination, and Uncertainty-Based Decontamination (UBD) — deep LoRA ensembles exposing memorized samples as confident-but-batch-order-sensitive — debiases without a clean reference model.