Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Revisiting Logit Distributions for Reliable Out-of-Distribution Detection

About

Out-of-distribution (OOD) detection is critical for ensuring the reliability of deep learning models in open-world applications. While post-hoc methods are favored for their efficiency and ease of deployment, existing approaches often underexploit the rich information embedded in the model's logits space. In this paper, we propose LogitGap, a novel post-hoc OOD detection method that explicitly exploits the relationship between the maximum logit and the remaining logits to enhance the separability between in-distribution (ID) and OOD samples. To further improve its effectiveness, we refine LogitGap by focusing on a more compact and informative subset of the logit space. Specifically, we introduce a training-free strategy that automatically identifies the most informative logits for scoring. We provide both theoretical analysis and empirical evidence to validate the effectiveness of our approach. Extensive experiments on both vision-language and vision-only models demonstrate that LogitGap consistently achieves state-of-the-art performance across diverse OOD detection scenarios and benchmarks. Code is available at https://github.com/GIT-LJc/LogitGap.

Jiachen Liang, Ruibing Hou, Minyang Hu, Hong Chang, Shiguang Shan, Xilin Chen• 2025

Related benchmarks

TaskDatasetResultRank
Out-of-Distribution DetectionImageNet-1K
FPR@9539.7
156
Out-of-Distribution DetectionImageNet
AUROC90.6
113
Out-of-Distribution DetectionCUB
AUC80.5
102
OOD DetectionImageNet-54 (test)
AUC94.2
85
Out-of-Distribution DetectionImageNet-1K OOD Average
AUROC79.4
71
Out-of-Distribution DetectionImageNet-1k vs NINCO
AUROC76.5
50
Out-of-Distribution DetectionImageNet1K-OpenOOD ImageNet-O
FPR9572
21
Out-of-Distribution DetectionImageNet1K OpenOOD
FPR@9575.4
21
Compositional Out-of-Distribution DetectionImageNet
AUC69.9
17
Out-of-Distribution DetectionImageNet-A-R-S-V2 vs original ImageNet (variant of setup-iii)
AUC67.6
17
Showing 10 of 11 rows

Other info

Follow for update