Share your thoughts, 1 month free Claude Pro on usSee more

Industrial Anomaly Detection on MMAD one-shot 1.0 (test)

95.24Anomaly Discrimination Score

Human (expert)

Updated 1mo ago

Evaluation Results

Method
Human (expert) 2026.02	95.24	75	92.31	83.33	94.2	86.11	80.37	86.65
Human (ordinary) 2026.02	86.9	66.25	85.58	71.25	81.52	89.58	69.72	78.69
Gemini-1.5-flash 2026.02	83.38	69.88	63.3	76.41	81.57	94.04	82	78.65
Gemini-1.5-pro 2026.02	83.07	73.86	67.2	79.97	86.27	94.88	83.08	81.19
Reason-IAD (Qwen3-VL) 2026.02	75.24	75.07	62.78	76.38	85.58	96.31	84.62	79.43
Reason-IAD (Qwen3-VL) 2026.02	75.05	73.72	66.48	76.83	82.33	94.9	84.41	79.1
Qwen3-VL 2026.02	74.02	59.25	62.74	70.09	79.22	92.47	83.59	74.48
Qwen3-VL 2026.02	73.08	62.33	60.34	69.15	80.09	92.53	84.01	74.51
GLM-4.1V-Thinking 2026.02	72.31	72.01	66.47	79.98	84.61	93.79	83.26	78.92
Qwen2.5-VL 2026.02	71.79	55.23	68.97	64.54	78.9	92.55	84.66	72.38
Reason-IAD (Qwen2.5-VL) 2026.02	70.74	67.97	60.82	72.78	82.62	97.17	84.99	76.73
Qwen3-VL 2026.02	70.29	50.42	49.35	64.69	78.09	91.45	80.43	69.24
GPT-4o 2026.02	68.63	65.8	55.62	73.21	83.41	94.98	82.8	74.92
InternVL2 2026.02	68.25	54.22	56.66	66.3	80.47	86.4	82.92	70.75
Kimi-VL 2026.02	66.57	71.72	61.88	79.78	82.93	92.18	86.51	77.37
AnomalyGPT 2026.02	65.57	27.49	27.97	36.86	32.11	29.84	35.82	36.52
GPT-4o-mini 2026.02	64.1	67.35	69.07	79.02	86.72	93.96	83.37	77.65
Qwen2.5-VL 2026.02	63.03	47.47	54.87	66.66	80.57	86.85	82.84	68.87
Reason-IAD (Qwen3-VL) 2026.02	61.9	70.2	54.63	71.51	79.92	94.59	81.61	73.48
AnomalyR1 2026.02	60.62	63.56	70.14	80.47	85.28	92.48	86.15	76.96
Claude-3.5-sonnet 2026.02	60.14	60.14	48.81	67.13	79.11	85.19	79.83	68.36
InternVL2 2026.02	59.97	43.85	47.91	57.6	78.1	74.18	80.37	63.14
LLaVA-NeXT 2026.02	57.92	48.79	52.87	71.34	80.28	81.12	77.8	67.16
LLaVA-NeXT 2026.02	57.64	33.79	47.72	51.84	67.93	81.39	74.91	59.32
Qwen3-VL-thinking 2026.02	52.31	41.5	40.37	45.67	36.02	64.34	53.3	47.64
LLaVA-OneVision 2026.02	51.77	46.13	41.85	62.19	69.73	90.31	80.93	63.27
LLaVA-1.5 2026.02	51.33	37.04	36.62	50.6	69.79	68.29	69.53	54.74
Random Chance 2026.02	50	25	25	25	25	25	25	28.57
LLaVA-1.5 2026.02	49.96	38.78	46.17	58.17	73.09	73.62	70.98	58.68