Share your thoughts, 1 month free Claude Pro on usSee more

Long Video Question Answering on Video-MME

75.7Average Accuracy (w/o subs)

VideoRAG-72B

Updated 1mo ago

Evaluation Results

Method	Links
VideoRAG-72B 2025.06		75.7	81.1	-	72.9	-	73.1	-	-
Gemini 1.5 Pro 2025.06		75	81.7	84.5	74.3	81	67.4	77.4	81.3
VideoChat-A1 2025.06		72.9	81.4	82.4	72.8	76.7	65	71.2	76.8
InternVL-3-78B 2025.06		72.7	-	-	-	-	-	-	75.7
VideoChat-A1 2025.06		72.3	80.8	81.4	72.3	76.8	63.7	72.6	77
InternVL-2.5-78B 2025.06		72.1	82.8	83.2	70.9	74.1	62.6	64.8	74
GPT-4o(0513) 2025.06		71.9	80	82.8	70.3	76.6	65.3	72.1	77.2
VideoChat-A1 2025.06		71.8	78	81.2	73.1	77.4	64.3	70.9	76.5
Qwen2.5-VL-72B 2025.06		71.2	80.1	82.2	71.3	76.8	62.2	74.3	77.8
LLAVA-Video-72B 2025.06		70.6	81.4	82.8	68.9	75.6	61.5	72.5	76.9
T* 2025.06		68.3	61	-	66.6	-	77.5	-	-
LLaVA-OneVision-72B 2025.06		66.3	76.7	79.3	62.2	66.9	60	62.4	69.6
InternVL-3-8B 2025.06		66.3	-	-	-	-	-	-	68.9
Qwen2.5-VL-7B 2025.06		65.1	-	-	-	-	-	-	71.6
InternVideo-2.5-8B 2025.06		65.1	-	-	-	-	-	-	-
InternVL-2.5-8B 2025.06		64.2	-	-	-	-	-	-	66.9
LLaVA-Video-7B 2025.06		63.3	-	-	-	-	-	-	69.7
VideoLLaMA-2-72B 2025.06		62.4	69.8	72	59.9	63	57.6	59	64.7
VideoMind 2025.06		58.2	-	-	-	-	49.2	-	-
DrVideo 2025.06		51.7	-	-	-	-	-	-	71.7
ShareGPT4Video-8B 2025.06		39.9	48.3	53.6	36.3	39.3	35	37.9	43.6
VideoChat2-7B 2025.06		39.5	48.3	52.8	37	39.4	33.2	39.2	43.8
LongVU-7B 2025.06		-	-	-	-	-	-	59.5	60.6