Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

The Signal in the Noise: OOD Detection Through Goodness-of-Fit Testing in Factorised Latent Spaces

About

Deep generative models offer a natural foundation for out-of-distribution (OOD) detection, yet prior work has shown that their assigned likelihoods are notoriously unreliable indicators for in- vs out-of-distribution data. In this paper, we address this problem by leveraging the diffeomorphic and mass-preserving properties of continuous normalising flows. Our analysis shows that OOD samples are mapped to noise samples that are highly atypical under the noise prior in ways not captured by the likelihood. Based on this observation, we propose a new method -- Signal in the Noise (SITN) -- for OOD detection on the single-sample level. SITN requires no access to OOD data, incurs minimal computational overhead, and provides strict control of false positive rates. Comprehensive evaluations through standard benchmarks and synthetic perturbations highlight the method's effectiveness and the absence of the complexity bias inherent to likelihood-based methods.

Philipp Bomatter, Jack Geary, Henry Gouk• 2026

Related benchmarks

TaskDatasetResultRank
Out-of-Distribution DetectionCIFAR-10 (ID) vs SVHN (OOD) (test)
AUROC94.6
92
Out-of-Distribution DetectionCIFAR10 (ID) vs SVHN (OOD)
AUROC94.6
81
Out-of-Distribution DetectionCIFAR-10 (ID) vs Celeb-A (OOD)
AUROC67.1
79
Out-of-Distribution DetectionSVHN (In) CelebA (Out) (test)
AUROC99.6
27
Out-of-Distribution DetectionCelebA (In) CIFAR-10 (Out) (test)
AUROC0.91
18
OOD DetectionCelebA (In) vs SVHN (Out)
AUROC0.986
13
Out-of-Distribution DetectionSVHN (ID) vs CIFAR-10 (OOD)
AUROC98.6
4
Out-of-Distribution DetectionSVHN (ID) vs CIFAR-10 (OOD) (test)
AUROC98.6
4
Out-of-Distribution DetectionCelebA (ID) vs SVHN (OOD) (test)
AUROC98.6
4
Showing 9 of 9 rows

Other info

Follow for update