Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

The MVTec 3D-AD Dataset for Unsupervised 3D Anomaly Detection and Localization

About

We introduce the first comprehensive 3D dataset for the task of unsupervised anomaly detection and localization. It is inspired by real-world visual inspection scenarios in which a model has to detect various types of defects on manufactured products, even if it is trained only on anomaly-free data. There are defects that manifest themselves as anomalies in the geometric structure of an object. These cause significant deviations in a 3D representation of the data. We employed a high-resolution industrial 3D sensor to acquire depth scans of 10 different object categories. For all object categories, we present a training and validation set, each of which solely consists of scans of anomaly-free samples. The corresponding test sets contain samples showing various defects such as scratches, dents, holes, contaminations, or deformations. Precise ground-truth annotations are provided for every anomalous test sample. An initial benchmark of 3D anomaly detection methods on our dataset indicates a considerable room for improvement.

Paul Bergmann, Xin Jin, David Sattlegger, Carsten Steger• 2021

Related benchmarks

TaskDatasetResultRank
Anomaly DetectionMVTec 3D-AD 1.0 (test)
Mean Score0.699
134
Anomaly DetectionMVTec 3D-AD
I-AUROC69.9
47
Anomaly SegmentationMVTec 3D-AD
Mean Score63.9
40
Anomaly LocalizationMVTec 3D-AD
AUPRO (Mean)56.4
29
Anomaly DetectionMVTec 3D-AD
AUPRO@30% (Bagel)66.4
23
Anomaly SegmentationMVTec-3D 1.0 (test)
Bagel0.664
21
Anomaly DetectionMVTec 3D-AD
AUPRO@30%58.3
17
Showing 7 of 7 rows

Other info

Code

Follow for update