Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MVTec

Benchmarks

Task NameDataset NameSOTA ResultTrend
Pixel-level Anomaly DetectionMVTec
Pixel AUROC99.7
127
Anomaly GenerationMVTec 1 (test)
Image Similarity (IS)2.54
112
OOD detectionMVTec Metal Nut Dissimilar
AUROC0.7966
90
OOD DetectionMVTec Pill (Dissimilar)
AUROC86.15
90
OOD DetectionMVTec Pill (Similar)
AUROC93.33
90
Anomaly DetectionMVTec
AUROC99.6
79
Anomaly LocalizationMVTec
AUC99.6
78
Anomaly LocalizationMVTec (test)
avg AUROC98.6
32
OOD detectionMVTec Metal Nut - Similar artifacts
AUROC (%)85.11
30
OOD DetectionMVTec Metal Nut (Similar)
AUROC78.3
30
OOD detectionMVTec Metal Nut - Similar artifacts (test)
AUROC85.23
30
Anomaly SegmentationMVTec
AUROC0.9771
28
Anomaly Detection and LocalizationMVTec3D-RGB
Image AUROC90.6
26
Image-level Anomaly DetectionMvtec LOCO AD
AUROC (Logical)86
26
Anomaly ReasoningMVTec-COT (test)
ROUGE-L27.1
24
Image-level Anomaly DetectionMVTec
Average ROCAUC97.6
20
Anomaly DetectionMVTec (test)
Image-level AUROC95.3
18
Instance-level anomaly detectionMVTec AD
Avg mAP0.494
15
Anomaly DetectionMVTec anomaly detection (test)
AUC (object)99.3
15
Anomaly LocalizationMVTec 4 (test)
AUROC0.9862
14
Interactive SegmentationMVTec
NoC@9010.56
13
OOD detectionMVTec
AUROC96.5
11
Image-level Anomaly DetectionMVTec SL (test)
Sensitivity (S)99.8
11
Out-of-Distribution DetectionMVTec Aggregate
Delta(S-D)20.64
10
Out-of-Distribution DetectionMVTec Metal Nut
AUROC Similar78.3
10
Showing 25 of 59 rows