Share your thoughts, 1 month free Claude Pro on usSee more

Video Question Answering on MLVU (dev)

78.1Accuracy

Qwen3-VL

Updated 8d ago

Evaluation Results

Method	Links
Qwen3-VL 2026.05		78.1
LLaVA-OV-2 2026.05		76.6
Keye-VL-1.5 2026.05		75
A.I.R. + InternVL-3 2025.10		74.5
InternVL-3 + MDP3 2025.10		74
InternVL-3 (reported) 2025.10		71.4
InternVL-3.5 2026.05		71
QwenVL-2.5 (reported) 2025.10		70.2
A.I.R. + LLaVA-OneVision 2025.10		69.3
InternVL-3 (reproduced) 2025.10		68.4
LLaVA-OneVision + MDP3 2025.10		68.3
LLaVA-OneVision-7B + ReKV 2025.05		68.2
LiveVLM 2025.05		68.1
A.I.R. + QwenVL-2.5 2025.10		67.5
LLaVA-OneVision-7B + StreamMem 2025.05		66.9
LLaVA-OneVision + BOLT 2025.10		66.8
PLM 2026.05		66.4
QwenVL-2.5 + MDP3 2025.10		66.2
VideoXL-7B 2025.05		64.9
LLaVA-OneVision (reported) 2025.10		64.7
LLaVA-OneVision-7B 2025.05		64.7
LLaVA-OneVision (reproduced) 2025.10		62.4
LLaVA-OV-1.5 2026.05		62.1
Dispider-7B 2025.05		61.7
Kangaroo-8B 2025.05		61
QwenVL-2.5 (reproduced) 2025.10		59.3
LongVA-7B 2025.05		56.3
VILA-1.5 + Q-Frame 2025.10		54.4
A.I.R. + VILA-1.5 2025.10		54.2
VILA-1.5 + MDP3 2025.10		52.3
VILA-1.5 + Frame-Voyager 2025.10		49.8
VILA-1.5 (reported) 2025.10		46.3
VILA-1.5 (reproduced) 2025.10		44.7
MovieChat-7B 2025.05		25.8