Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

GL-MCM: Global and Local Maximum Concept Matching for Zero-Shot Out-of-Distribution Detection

About

Zero-shot out-of-distribution (OOD) detection is a task that detects OOD images during inference with only in-distribution (ID) class names. Existing methods assume ID images contain a single, centered object, and do not consider the more realistic multi-object scenarios, where both ID and OOD objects are present. To meet the needs of many users, the detection method must have the flexibility to adapt the type of ID images. To this end, we present Global-Local Maximum Concept Matching (GL-MCM), which incorporates local image scores as an auxiliary score to enhance the separability of global and local visual features. Due to the simple ensemble score function design, GL-MCM can control the type of ID images with a single weight parameter. Experiments on ImageNet and multi-object benchmarks demonstrate that GL-MCM outperforms baseline zero-shot methods and is comparable to fully supervised methods. Furthermore, GL-MCM offers strong flexibility in adjusting the target type of ID images. The code is available via https://github.com/AtsuMiyai/GL-MCM.

Atsuyuki Miyai, Qing Yu, Go Irie, Kiyoharu Aizawa• 2023

Related benchmarks

TaskDatasetResultRank
Out-of-Distribution DetectioniNaturalist
AUROC96.71
252
Out-of-Distribution DetectionSUN OOD with ImageNet-1k In-distribution (test)
FPR@9529.16
247
Out-of-Distribution DetectionTextures
AUROC0.8311
186
Out-of-Distribution DetectionPlaces
FPR9538.85
175
Out-of-Distribution DetectionImageNet-1K
FPR@9528.3
156
Out-of-Distribution DetectionTexture
AUROC83.63
128
Out-of-Distribution DetectionImageNet
AUROC91.1
113
Out-of-Distribution DetectionSUN
FPR@9530.42
104
Out-of-Distribution DetectionCUB
AUC78.3
102
OOD DetectionPlaces (OOD)
AUROC90.37
100
Showing 10 of 31 rows

Other info

Follow for update