Share your thoughts, 1 month free Claude Pro on usSee more

Cross-modal Hallucination Detection on Curse of Multi-Modalities (CMM) 1.0 (test)

96.5VL Precision (pa)

Qwen 3 Omni

Updated 1mo ago

Evaluation Results

Method	Links
Qwen 3 Omni 2026.03		96.5	77.5	93	88	97.5	94	95.5	60	94.5	67	93	65	95	75.3
VITA 1.5 2026.03		92.5	91.5	42.5	30.5	77.7	72.9	57	24.4	77.4	67.7	86	55.5	72.2	57.1
Qwen 2.5 Omni + MoD-DPO++ 2026.03		92.5	98.5	92.7	85.8	94.5	95.5	91.3	75.1	89.1	84.3	74.9	83.8	89.2	87.2
Qwen 2.5 Omni + MoD-DPO 2026.03		91.5	98.5	92.3	83.2	94.5	94.5	92.3	74.2	88.4	83.8	73.9	83.1	88.8	86.2
MiniCPM-O 2.6 + MoD-DPO 2026.03		90.5	95.5	92	76	91.5	86	82.5	84.8	89	78.9	82.4	73.7	88	82.5
MiniCPM-O 2.6 + MoD-DPO++ 2026.03		90	96.5	92.5	77.5	91.5	87	83.5	85.6	88.4	79.6	83.8	75.1	88.3	83.6
Qwen 2.5 Omni + OmniDPO 2026.03		89	98	89.5	83.5	94	93	88.8	69.9	86.1	81.3	72.2	82.6	86.6	84.7
OmniVinci 2026.03		88.5	81	74.5	90	98	72	91	63.5	96	35	87	75	89.2	69.4
Qwen 2.5 Omni 2026.03		88	98	89.9	84.4	93	93.5	87.8	67.7	85.3	80.7	74.2	83.2	86.4	84.6
MiniCPM-O 2.6 + OmniDPO 2026.03		88	95	91	76.5	88.5	84	79.1	78.8	88.4	77.8	83.2	71.6	86.4	80.6
MiniCPM-O 2.6 2026.03		87	94	90.5	74	87	84	79.5	80.5	87.4	76.4	82	73.7	85.6	80.4
MiniCPM-O 2.6 + DPO 2026.03		87	93	89.5	74.5	86	84.5	79.5	79.5	87.8	76	81.5	74.3	85.2	80.3
Qwen 2.5 Omni + DPO 2026.03		86	98.5	89.5	86.5	92.4	94.4	86.7	63.5	84.3	80.4	72.5	84.1	85.2	84.6
VideoLLaMA 2 2026.03		75	86	77.5	94	78	98	62	75.5	80	90	57.5	43	71.7	81.1