Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Breaking Semantic Hegemony: Decoupling Principal and Residual Subspaces for Generalized OOD Detection

About

While feature-based post-hoc methods have made significant strides in Out-of-Distribution (OOD) detection, we uncover a counter-intuitive Simplicity Paradox in existing state-of-the-art (SOTA) models: these models exhibit keen sensitivity in distinguishing semantically subtle OOD samples but suffer from severe Geometric Blindness when confronting structurally distinct yet semantically simple samples or high-frequency sensor noise. We attribute this phenomenon to Semantic Hegemony within the deep feature space and reveal its mathematical essence through the lens of Neural Collapse. Theoretical analysis demonstrates that the spectral concentration bias, induced by the high variance of the principal subspace, numerically masks the structural distribution shift signals that should be significant in the residual subspace. To address this issue, we propose D-KNN, a training-free, plug-and-play geometric decoupling framework. This method utilizes orthogonal decomposition to explicitly separate semantic components from structural residuals and introduces a dual-space calibration mechanism to reactivate the model's sensitivity to weak residual signals. Extensive experiments demonstrate that D-KNN effectively breaks Semantic Hegemony, establishing new SOTA performance on both CIFAR and ImageNet benchmarks. Notably, in resolving the Simplicity Paradox, it reduces the FPR95 from 31.3% to 2.3%; when addressing sensor failures such as Gaussian noise, it boosts the detection performance (AUROC) from a baseline of 79.7% to 94.9%.

Ningkang Peng, Xiaoqian Peng, Yuhao Zhang, Qianfeng Yu, Feng Xing, Peirong Ma, Xichen Yang, Yi Chen, Tingyu Lu, Yanhui Gu• 2026

Related benchmarks

TaskDatasetResultRank
Out-of-Distribution DetectionSUN OOD with ImageNet-1k In-distribution (test)
FPR@9566.8
159
Out-of-Distribution DetectionPlaces with ImageNet-1k OOD In-distribution (test)
FPR9574.8
99
Out-of-Distribution DetectionImageNet-1k ID iNaturalist OOD
FPR9547
87
Out-of-Distribution DetectionImageNet-O
AUROC0.791
74
Out-of-Distribution DetectionImageNet-1k Textures ID OOD
AUROC95.6
59
Out-of-Distribution DetectionImageNet-1K OOD Average
AUROC85.2
31
OOD DetectionCIFAR-100
FPR95 (EMNIST)5
22
Out-of-Distribution DetectionImageNet-1k vs NINCO
AUROC89.1
13
Out-of-Distribution DetectionImageNet-1k vs OpenImage-O
AUROC (%)83.9
13
Out-of-Distribution DetectionCIFAR-100
EMNIST FPR951.9
11
Showing 10 of 12 rows

Other info

Follow for update