Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

PromptAD: Learning Prompts with only Normal Samples for Few-Shot Anomaly Detection

About

The vision-language model has brought great improvement to few-shot industrial anomaly detection, which usually needs to design of hundreds of prompts through prompt engineering. For automated scenarios, we first use conventional prompt learning with many-class paradigm as the baseline to automatically learn prompts but found that it can not work well in one-class anomaly detection. To address the above problem, this paper proposes a one-class prompt learning method for few-shot anomaly detection, termed PromptAD. First, we propose semantic concatenation which can transpose normal prompts into anomaly prompts by concatenating normal prompts with anomaly suffixes, thus constructing a large number of negative samples used to guide prompt learning in one-class setting. Furthermore, to mitigate the training challenge caused by the absence of anomaly images, we introduce the concept of explicit anomaly margin, which is used to explicitly control the margin between normal prompt features and anomaly prompt features through a hyper-parameter. For image-level/pixel-level anomaly detection, PromptAD achieves first place in 11/12 few-shot settings on MVTec and VisA.

Xiaofan Li, Zhizhong Zhang, Xin Tan, Chengwei Chen, Yanyun Qu, Yuan Xie, Lizhuang Ma• 2024

Related benchmarks

TaskDatasetResultRank
Anomaly LocalizationMVTec AD
Pixel AUROC96.2
513
Anomaly DetectionMVTec-AD (test)
I-AUROC96.6
327
Anomaly DetectionVisA
AUROC89.1
261
Anomaly LocalizationMVTec-AD (test)
Pixel AUROC96.5
211
Anomaly DetectionMVTec-AD (test)
P-AUROC96.5
152
Anomaly LocalizationVisA
P-AUROC0.971
119
Anomaly DetectionVisA (test)
I-AUROC89.1
91
Anomaly DetectionMVTec AD--
83
Anomaly DetectionMVTec AD
Image-level AUROC96.6
52
Anomaly DetectionVisA--
52
Showing 10 of 44 rows

Other info

Code

Follow for update