Share your thoughts, 1 month free Claude Pro on usSee more

Video Understanding on FAVOR-Bench

50.28AS

Qwen2.5-VL-72B*

Updated 1mo ago

Evaluation Results

Method
Qwen2.5-VL-72B* 2026.06	50.28	46.98	48.13	51.78	40.28	51.56	48.14	48.17
Qwen2.5VL-7B + MotionEnhancer 2026.06	49.34	50.62	45.37	53.2	30.42	53.12	46.88	47.01
LLaVA-Video-72B-Qwen2 2026.06	48.35	47.5	45.25	51.7	33.02	53.12	46.08	46.49
InternVL3-8B + MotionEnhancer 2026.06	47.17	57.11	46.57	56.35	36.74	51.56	48.94	49.25
VideoLLaMA3-2B + FAVOR-Train + MOSS 2026.04	46.8	55	45.7	52.2	28.8	53.3	46.6	-
Qwen2.5VL-7B + MotionSight* 2026.06	46.23	51.59	45.01	50.04	29.95	53.12	45.47	45.99
InternVL3-8B* 2026.06	45.39	48.54	47.59	51.45	33.58	51.56	45.82	46.35
Qwen2.5VL-3B + MotionEnhancer 2026.06	45.01	51.59	44.4	48.96	28.37	45.31	44.53	43.94
VideoLLaMA3-2B + FAVOR-Train 2026.04	44.8	54.5	45.3	51.3	27.8	54.7	45.5	-
VideoLLaMA3-2B 2026.04	43.8	44.4	42.8	48.1	27.3	45.3	42.2	-
VideoChat-Flash-Qwen2-7B 2026.06	41.9	48.41	42.84	50.95	35.07	50	43.82	44.86
Qwen2.5VL-7B* 2026.06	41.64	47.83	44.89	47.55	28.28	45.31	42.61	42.58
VideoLLaMA3-7B 2026.06	40.2	44.13	42.42	48.3	31.53	42.19	41.46	41.46
Full Cache 2025.11	39.63	43.61	43.2	43.57	33.67	40.62	40.91	-
InternVL3-2B + MotionEnhancer 2026.06	38.53	54.57	42.6	51.78	33.02	51.56	43.71	45.35
Qwen2.5VL-3B* 2026.06	38.45	38.16	39.35	43.4	23.72	45.31	37.43	38.07
InternVL2.5-78B 2026.06	38.38	40.62	39.05	43.65	29.4	39.06	38.54	38.36
InternVL3-2B* 2026.06	37.66	43.28	40.49	44.98	29.21	39.06	39.27	39.11
LLaVA-Video-7B-Qwen2 2026.06	36.14	41.27	41.28	44.48	29.58	46.88	38.6	39.94
H2O 2025.11	32.16	38.22	39.05	40.66	31.35	23.44	35.78	-
LLaVA-NeXT-Video-34B 2026.06	31.7	31.99	32.31	22.99	29.58	46.88	30.44	32.58
StreamingLLM 2025.11	30.94	39.13	39.05	40.5	31.35	28.12	35.57	-
LOOK-M 2025.11	30.38	40.23	39.53	43.4	32.56	25	36.25	-
FlashCache 2025.11	30.38	40.1	41.16	40.91	34.14	35.94	36.49	-
VideoLLaMA3-2B 2026.06	28.97	36.6	34.9	38.01	28.56	40.62	32.98	34.61
SnapKV 2025.11	28.9	39.71	40.91	39.83	33.49	39.06	35.67	-
MEDA 2025.11	26.17	36.28	37.61	39.75	31.91	21.88	33.11	-
Video-LLaVA-7B 2026.06	24.91	21.54	25.45	30.54	26.23	21.88	25.37	25.09
SnapKV 2025.11	24.19	32.25	34.66	34.69	29.02	15.62	29.95	-
H2O 2025.11	21.35	28.68	32.19	31.45	28.56	12.5	27.3	-
FlashCache 2025.11	21.27	34.78	37.55	34.69	33.21	26.56	30.71	-
LLaVA-NeXT-Video-7B 2026.06	21.27	22.45	26.05	26.72	23.07	14.06	23.45	22.27
StreamingLLM 2025.11	20.52	29.4	32.55	31.29	28	12.5	27.14	-
LOOK-M 2025.11	20.29	30.11	32.49	33.61	31.81	12.5	28.03	-
InternVL2.5-2B 2026.06	18.7	28.23	23.71	27.47	19.16	23.44	22.9	23.45
MEDA 2025.11	15.17	24.72	25.99	29.13	27.53	12.5	22.83	-
Tarsier-7B 2026.06	12.55	21.16	17.87	17.93	22.23	31.25	17.46	20.5