Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Ranked Activation Shift for Post-Hoc Out-of-Distribution Detection

About

State-of-the-art post-hoc out-of-distribution detection methods rely on intermediate layer activation editing. However, they exhibit inconsistent performance across datasets and models. We show that this instability is driven by differences in the activation distributions, and identify a failure mode of scaling-based methods that arises when penultimate layer activations are not rectified. Motivated by this analysis, we propose \ours, a hyperparameter-free post-hoc method that replaces sorted activation magnitudes with a fixed in-distribution reference profile. Our simple plug-and-play method shows strong and consistent performance across datasets and architectures without assumptions on the penultimate layer activation function, and without requiring any hyperparameter tuning, while preserving in-distribution classification accuracy by construction. We further analyze what drives the improvement, showing that both inhibiting and exciting activation shifts independently contribute to better out-of-distribution discrimination.

Gianluca Guglielmo, Marc Masana• 2026

Related benchmarks

TaskDatasetResultRank
Out-of-Distribution DetectioniNaturalist
AUROC77.04
219
Out-of-Distribution DetectionTextures
AUROC0.723
168
Out-of-Distribution DetectionNINCO
AUROC56.9
82
OOD DetectionImageNet
AUROC86.55
77
Out-of-Distribution DetectionSSB hard
AUROC (%)47.81
74
Out-of-Distribution DetectionTextures (test)
AUROC0.7809
53
Out-of-Distribution DetectioniNaturalist (test)
AUROC82.69
44
OOD DetectionCIFAR-10
FPR@9540.16
32
Out-of-Distribution DetectionOpenImage-O (test)
AUROC75.85
22
Out-of-Distribution DetectionNINCO (test)
AUROC0.6406
22
Showing 10 of 13 rows

Other info

Follow for update