The MVTec 3D-AD Dataset for Unsupervised 3D Anomaly Detection and Localization
About
We introduce the first comprehensive 3D dataset for the task of unsupervised anomaly detection and localization. It is inspired by real-world visual inspection scenarios in which a model has to detect various types of defects on manufactured products, even if it is trained only on anomaly-free data. There are defects that manifest themselves as anomalies in the geometric structure of an object. These cause significant deviations in a 3D representation of the data. We employed a high-resolution industrial 3D sensor to acquire depth scans of 10 different object categories. For all object categories, we present a training and validation set, each of which solely consists of scans of anomaly-free samples. The corresponding test sets contain samples showing various defects such as scratches, dents, holes, contaminations, or deformations. Precise ground-truth annotations are provided for every anomalous test sample. An initial benchmark of 3D anomaly detection methods on our dataset indicates a considerable room for improvement.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Anomaly Detection | MVTec 3D-AD 1.0 (test) | Mean Score0.699 | 107 | |
| Anomaly Segmentation | MVTec 3D-AD | Mean Score63.9 | 30 | |
| Anomaly Segmentation | MVTec-3D 1.0 (test) | Bagel0.664 | 21 |