Tippett-minimum Fusion of Representation-space Diffusion Models for Multi-Encoder Out-of-Distribution Detection
About
We address out-of-distribution (OOD) detection across the full spectrum of distribution shifts -- global domain changes, semantic divergence, texture differences, and covariate corruptions -- through a multi-encoder fusion of per-encoder representation-space diffusion models (RDMs). We statistically identify each encoder's sensitivity to specific shift types from ID data alone and introduce EncMin2L -- an encoder-agnostic two-level $\min(\cdot)$-gate that combines and calibrates per-encoder diffusion-based likelihood detectors without OOD labels, outperforming monolithic multi-encoder baselines at $2.3\times$ lower parameter cost. Two ID-data diagnostics: $\eta^2$ (class-conditional F-test) and $\Delta\mu$ (log-likelihood shift under synthetic corruptions) -- quantify encoder specialization, while a Tippett minimum $p$-value combination aggregates per-encoder scores into a single, calibration-stable OOD signal. EncMin2L achieves $\geq 0.94$ AUROC across all four shift types simultaneously, outperforming the state-of-the-art representation-space diffusion OOD detectors across overlapping benchmarks.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Out-of-Distribution Detection | CIFAR-100 SVHN in-distribution out-of-distribution (test) | AUROC80.6 | 107 | |
| Out-of-Distribution Detection | CIFAR 10 (Near OOD) | AUROC96.3 | 44 | |
| Out-of-Distribution Detection | CIFAR-100 (In-distribution) vs CIFAR-10 (OOD) (test) | AUROC89.2 | 40 | |
| Out-of-Distribution Detection | CIFAR 100 Near OOD | AUROC94.2 | 38 | |
| Out-of-Distribution Detection | SVHN Near-OOD | AUROC95.1 | 18 | |
| Out-of-Distribution Detection | CelebA Far-OOD | AUROC100 | 16 | |
| Out-of-Distribution Detection | DTD Far-OOD | AUROC99.9 | 16 | |
| Out-of-Distribution Detection | CIFAR-100 ID DTD OOD (test) | AUROC100 | 15 | |
| Out-of-Distribution Detection | CIFAR-100 ID CelebA OOD (test) | AUROC100 | 15 |