Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Balanced Energy Regularization Loss for Out-of-distribution Detection

About

In the field of out-of-distribution (OOD) detection, a previous method that use auxiliary data as OOD data has shown promising performance. However, the method provides an equal loss to all auxiliary data to differentiate them from inliers. However, based on our observation, in various tasks, there is a general imbalance in the distribution of the auxiliary OOD data across classes. We propose a balanced energy regularization loss that is simple but generally effective for a variety of tasks. Our balanced energy regularization loss utilizes class-wise different prior probabilities for auxiliary data to address the class imbalance in OOD data. The main concept is to regularize auxiliary samples from majority classes, more heavily than those from minority classes. Our approach performs better for OOD detection in semantic segmentation, long-tailed image classification, and image classification than the prior energy regularization loss. Furthermore, our approach achieves state-of-the-art performance in two tasks: OOD detection in semantic segmentation and long-tailed image classification. Code is available at https://github.com/hyunjunChhoi/Balanced_Energy.

Hyunjun Choi, Hawook Jeong, Jin Young Choi• 2023

Related benchmarks

TaskDatasetResultRank
Out-of-Distribution DetectionImageNet OOD Average 1k (test)
FPR@9525.31
137
Out-of-Distribution DetectionCIFAR-100
AUROC95.65
107
Out-of-Distribution DetectionCIFAR100 (test)
AUROC91.35
57
OOD DetectionCIFAR100-LT (test)
AUROC77.75
12
OOD DetectionCIFAR10 LT (test)
AUROC92.56
12
Showing 5 of 5 rows

Other info

Follow for update