Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

When Accuracy Is Not Enough: Uncertainty Collapse between Noisy Label Learning and Out-of-Distribution Detection

About

Learning with noisy labels (LNL) is typically benchmarked by closed-set classification accuracy, yet deployment often requires classifiers to reject out-of-distribution (OOD) inputs. We present a learner-agnostic ACC-OOD benchmark that freezes LNL checkpoints and evaluates them with standardized near-/far-OOD routing and post-hoc scores across synthetic and real label noise. The benchmark reveals a recurring failure mode: high closed-set accuracy does not ensure OOD reliability, because low-confidence, misclassified in-distribution samples can overlap the score and feature regions occupied by OOD inputs under noisy training. We term this pathology uncertainty collapse. This structural overlap can make high-accuracy LNL methods lose separability at the ID-error/OOD interface under standard OOD scores. As an intervention, we study Virtual Margin Regularization (VMR), a lightweight repair probe demonstrated mainly with PSSCL that synthesizes boundary virtual outliers on trusted ID batches and widens the energy margin. VMR partially reduces the collapse-induced far-OOD failure without replacing the host objective or sacrificing closed-set accuracy in the tested settings. These results support LNL benchmarks that co-report closed-set generalization, open-world reliability, and structural overlap diagnostics.

Ningkang Peng, Jingyang Mao, Runhan Zhou, Peirong Ma, Yanhui Gu• 2026

Related benchmarks

TaskDatasetResultRank
Out-of-Distribution DetectionCIFAR-10 (test)--
35
Image ClassificationFood101N--
19
Out-of-Distribution DetectionCIFAR-100 (test)--
14
Classification and Out-of-Distribution DetectionANIMAL-10N--
7
Out-of-Distribution DetectionFood-101N--
7
Classification and OOD DetectionCIFAR-10N (Aggregate (A))--
6
Classification and OOD DetectionCIFAR-10N (Random 1 (R1))--
6
Classification and OOD DetectionCIFAR-10N (Worst W)--
6
Classification and OOD DetectionCIFAR-100N--
6
Showing 9 of 9 rows

Other info

Follow for update