Share your thoughts, 1 month free Claude Pro on usSee more

Video Question Answering on MLVU (dev)

74.5Accuracy

A.I.R. + InternVL-3

Updated 20d ago

Evaluation Results

Method	Links
A.I.R. + InternVL-3 2025.10		74.5
InternVL-3 + MDP3 2025.10		74
InternVL-3 (reported) 2025.10		71.4
QwenVL-2.5 (reported) 2025.10		70.2
A.I.R. + LLaVA-OneVision 2025.10		69.3
InternVL-3 (reproduced) 2025.10		68.4
LLaVA-OneVision + MDP3 2025.10		68.3
A.I.R. + QwenVL-2.5 2025.10		67.5
LLaVA-OneVision + BOLT 2025.10		66.8
QwenVL-2.5 + MDP3 2025.10		66.2
LLaVA-OneVision (reported) 2025.10		64.7
LLaVA-OneVision (reproduced) 2025.10		62.4
QwenVL-2.5 (reproduced) 2025.10		59.3
VILA-1.5 + Q-Frame 2025.10		54.4
A.I.R. + VILA-1.5 2025.10		54.2
VILA-1.5 + MDP3 2025.10		52.3
VILA-1.5 + Frame-Voyager 2025.10		49.8
VILA-1.5 (reported) 2025.10		46.3
VILA-1.5 (reproduced) 2025.10		44.7