The MVTec 3D-AD Dataset for Unsupervised 3D Anomaly Detection and Localization
About
We introduce the first comprehensive 3D dataset for the task of unsupervised anomaly detection and localization. It is inspired by real-world visual inspection scenarios in which a model has to detect various types of defects on manufactured products, even if it is trained only on anomaly-free data. There are defects that manifest themselves as anomalies in the geometric structure of an object. These cause significant deviations in a 3D representation of the data. We employed a high-resolution industrial 3D sensor to acquire depth scans of 10 different object categories. For all object categories, we present a training and validation set, each of which solely consists of scans of anomaly-free samples. The corresponding test sets contain samples showing various defects such as scratches, dents, holes, contaminations, or deformations. Precise ground-truth annotations are provided for every anomalous test sample. An initial benchmark of 3D anomaly detection methods on our dataset indicates a considerable room for improvement.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Anomaly Detection | MVTec 3D-AD 1.0 (test) | Mean Score0.699 | 134 | |
| Anomaly Detection | MVTec 3D-AD | I-AUROC69.9 | 47 | |
| Anomaly Segmentation | MVTec 3D-AD | Mean Score63.9 | 40 | |
| Anomaly Localization | MVTec 3D-AD | AUPRO (Mean)56.4 | 29 | |
| Anomaly Detection | MVTec 3D-AD | AUPRO@30% (Bagel)66.4 | 23 | |
| Anomaly Segmentation | MVTec-3D 1.0 (test) | Bagel0.664 | 21 | |
| Anomaly Detection | MVTec 3D-AD | AUPRO@30%58.3 | 17 |