Share your thoughts, 1 month free Claude Pro on usSee more

Video Understanding on LongVideoBench (test)

82.3Accuracy (Overall)

VideoChat-M1

Updated 1mo ago

Evaluation Results

Method
VideoChat-M1 2025.11	82.3	-	-	-	-	-
GPT-4o 2025.11	66.7	-	-	-	-	-
Gemini-1.5-Pro 2025.11	64	-	-	-	-	-
SPAVA 2026.01	59.76	77.78	74.42	57.77	50.71	-
APB 2026.01	59.16	75.13	73.84	58.01	50.18	-
FULLATTN 2026.01	58.38	73.81	73.84	56.44	49.82	-
STARATTN 2026.01	58.26	74.07	72.67	57.28	50.53	-
XATTN 2026.01	57.59	72.49	73.84	57.77	47.52	-
SLOWFAST 2026.01	56.47	72.49	68.6	53.16	49.82	-
Qwen2-VL-72B 2025.11	55.6	-	-	-	-	-
SPAVA 2026.01	55.42	62.43	67.44	54.85	49.82	-
FULLATTN 2026.01	55.35	61.9	67.44	54.61	50	-
APB 2026.01	55.2	61.9	67.44	55.83	48.76	-
XATTN 2026.01	54.97	62.43	71.51	53.4	48.58	-
APB 2026.01	54.97	68.25	72.09	52.18	47.34	-
STARATTN 2026.01	54.52	68.78	70.93	53.64	45.39	-
STARATTN 2026.01	54.3	63.49	66.86	52.91	48.4	-
SPAVA 2026.01	54.3	68.25	70.93	53.88	44.86	-
FULLATTN 2026.01	53.47	69.31	70.93	52.18	43.79	-
XATTN 2026.01	53.03	66.14	69.19	52.18	44.33	-
SLOWFAST 2026.01	52.73	65.61	64.53	50.49	46.45	-
SLOWFAST 2026.01	51.46	60.85	66.86	50.24	44.5	-
SPARGE 2026.01	49.74	56.08	64.53	50.49	42.55	-
SPARGE 2026.01	49.37	65.08	66.86	47.09	40.43	-
SPARGE 2026.01	47.87	59.79	60.47	42.48	43.97	-
Vanilla (TMLR) 2025.12	-	-	-	-	-	57.7
VisionZip† 2025.12	-	-	-	-	-	56.5
VisionZip† + DyToK (7B) 2025.12	-	-	-	-	-	57
FastV (ECCV2024) 2025.12	-	-	-	-	-	56.1
FastV (ECCV2024) + DyToK (7B) 2025.12	-	-	-	-	-	58.3
VisionZip† 2025.12	-	-	-	-	-	56.8
VisionZip† + DyToK (7B) 2025.12	-	-	-	-	-	56.8
FastV (ECCV2024) 2025.12	-	-	-	-	-	53.2
FastV (ECCV2024) + DyToK (7B) 2025.12	-	-	-	-	-	57.9
VisionZip† 2025.12	-	-	-	-	-	55.1
VisionZip† + DyToK (7B) 2025.12	-	-	-	-	-	55.3
FastV (ECCV2024) 2025.12	-	-	-	-	-	49.3
FastV (ECCV2024) + DyToK (7B) 2025.12	-	-	-	-	-	54.5
VisionZip† 2025.12	-	-	-	-	-	55.4
VisionZip† + DyToK (7B) 2025.12	-	-	-	-	-	54.1
FastV (ECCV2024) 2025.12	-	-	-	-	-	47.1
FastV (ECCV2024) + DyToK (7B) 2025.12	-	-	-	-	-	51.1
VisionZip† 2025.12	-	-	-	-	-	53.2
VisionZip† + DyToK (7B) 2025.12	-	-	-	-	-	53.1
FastV (ECCV2024) 2025.12	-	-	-	-	-	42.3
FastV (ECCV2024) + DyToK (7B) 2025.12	-	-	-	-	-	42.3