Holistic Reliability Propagation: Decoupling Annotation and Prediction for Robust Noisy-Label
About
Learning with noisy labels in multimedia classification often combines external annotations and model predictions into a single reliability weight, even though the two sources can fail for different reasons. We instead estimate disentangled reliabilities: bilevel meta-learning produces two batch-normalized scalars per sample, alpha for the given label and beta for the pseudo-label, without constraining them to sum to one. Holistic Reliability Propagation (HRP) then routes them to different objectives, using reliability-aware Mixup with global gating on the input branch and beta-gated pseudo-label positives on the contrastive branch. On synthetic and real-world benchmarks, HRP improves average accuracy over strong baselines and remains competitive at the highest noise rates.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Classification | CIFAR-10 (test) | Accuracy96.4 | 882 | |
| Image Classification | CIFAR-100 (test) | Top-1 Accuracy81.6 | 395 | |
| Image Classification | ANIMAL-10N (test) | Accuracy84.3 | 123 | |
| OOD Detection | CIFAR-10 Sym0.8 (test) | AUROC91.2 | 15 | |
| OOD Detection | CIFAR-10 Sym0.5 (test) | AUROC94.1 | 15 | |
| OOD Detection | CIFAR-10 Sym0.2 (test) | AUROC0.95 | 15 | |
| OOD Detection | CIFAR-100 20% symmetric noise (test) | AUROC74.8 | 7 |