Our new X account is live! Follow @wizwand_team for updates

Industrial Anomaly Detection on MMAD one-shot 1.0 (test)

95.24Anomaly Discrimination Score

Human (expert)

Updated 4d ago

Evaluation Results

Method
Human (expert) 2026.02	95.24	75	92.31	83.33	94.2	86.11	80.37	86.65
Human (ordinary) 2026.02	86.9	66.25	85.58	71.25	81.52	89.58	69.72	78.69
Gemini-1.5-flash 2026.02	83.38	69.88	63.3	76.41	81.57	94.04	82	78.65
Gemini-1.5-pro 2026.02	83.07	73.86	67.2	79.97	86.27	94.88	83.08	81.19
Reason-IAD (Qwen3-VL) 2026.02	75.24	75.07	62.78	76.38	85.58	96.31	84.62	79.43
Reason-IAD (Qwen3-VL) 2026.02	75.05	73.72	66.48	76.83	82.33	94.9	84.41	79.1
Qwen3-VL 2026.02	74.02	59.25	62.74	70.09	79.22	92.47	83.59	74.48
Qwen3-VL 2026.02	73.08	62.33	60.34	69.15	80.09	92.53	84.01	74.51
GLM-4.1V-Thinking 2026.02	72.31	72.01	66.47	79.98	84.61	93.79	83.26	78.92
Qwen2.5-VL 2026.02	71.79	55.23	68.97	64.54	78.9	92.55	84.66	72.38
Reason-IAD (Qwen2.5-VL) 2026.02	70.74	67.97	60.82	72.78	82.62	97.17	84.99	76.73
Qwen3-VL 2026.02	70.29	50.42	49.35	64.69	78.09	91.45	80.43	69.24
GPT-4o 2026.02	68.63	65.8	55.62	73.21	83.41	94.98	82.8	74.92
InternVL2 2026.02	68.25	54.22	56.66	66.3	80.47	86.4	82.92	70.75
Kimi-VL 2026.02	66.57	71.72	61.88	79.78	82.93	92.18	86.51	77.37
AnomalyGPT 2026.02	65.57	27.49	27.97	36.86	32.11	29.84	35.82	36.52
GPT-4o-mini 2026.02	64.1	67.35	69.07	79.02	86.72	93.96	83.37	77.65
Qwen2.5-VL 2026.02	63.03	47.47	54.87	66.66	80.57	86.85	82.84	68.87
Reason-IAD (Qwen3-VL) 2026.02	61.9	70.2	54.63	71.51	79.92	94.59	81.61	73.48
AnomalyR1 2026.02	60.62	63.56	70.14	80.47	85.28	92.48	86.15	76.96
Claude-3.5-sonnet 2026.02	60.14	60.14	48.81	67.13	79.11	85.19	79.83	68.36
InternVL2 2026.02	59.97	43.85	47.91	57.6	78.1	74.18	80.37	63.14
LLaVA-NeXT 2026.02	57.92	48.79	52.87	71.34	80.28	81.12	77.8	67.16
LLaVA-NeXT 2026.02	57.64	33.79	47.72	51.84	67.93	81.39	74.91	59.32
Qwen3-VL-thinking 2026.02	52.31	41.5	40.37	45.67	36.02	64.34	53.3	47.64
LLaVA-OneVision 2026.02	51.77	46.13	41.85	62.19	69.73	90.31	80.93	63.27
LLaVA-1.5 2026.02	51.33	37.04	36.62	50.6	69.79	68.29	69.53	54.74
Random Chance 2026.02	50	25	25	25	25	25	25	28.57
LLaVA-1.5 2026.02	49.96	38.78	46.17	58.17	73.09	73.62	70.98	58.68