Focus Your Distribution: Coarse-to-Fine Non-Contrastive Learning for Anomaly Detection and Localization
About
The essence of unsupervised anomaly detection is to learn the compact distribution of normal samples and detect outliers as anomalies in testing. Meanwhile, the anomalies in real-world are usually subtle and fine-grained in a high-resolution image especially for industrial applications. Towards this end, we propose a novel framework for unsupervised anomaly detection and localization. Our method aims at learning dense and compact distribution from normal images with a coarse-to-fine alignment process. The coarse alignment stage standardizes the pixel-wise position of objects in both image and feature levels. The fine alignment stage then densely maximizes the similarity of features among all corresponding locations in a batch. To facilitate the learning with only normal images, we propose a new pretext task called non-contrastive learning for the fine alignment stage. Non-contrastive learning extracts robust and discriminating normal image representations without making assumptions on abnormal samples, and it thus empowers our model to generalize to various anomalous scenarios. Extensive experiments on two typical industrial datasets of MVTec AD and BenTech AD demonstrate that our framework is effective in detecting various real-world defects and achieves a new state-of-the-art in industrial unsupervised anomaly detection.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Anomaly Localization | MVTec AD | -- | 369 | |
| Anomaly Localization | MVTec (test) | avg AUROC97.4 | 32 | |
| Anomaly Detection | MVTec anomaly detection (test) | -- | 15 | |
| Anomaly Detection | MVTec AD 2019 (test) | Image-level AUC97.7 | 8 | |
| Anomaly Localization | MVTec AD 2019 (test) | Pixel AUC98.2 | 7 | |
| Anomaly Localization | BeanTech AD (test) | Category 01 Score96.1 | 4 | |
| Anomaly Detection | BeanTech AD (test) | Class 01 Score99.6 | 1 |