Share your thoughts, 1 month free Claude Pro on usSee more

Video Understanding on VideoMME (Length Segmentation)

67.4Score (Long)

Gemini-1.5-Pro

Updated 12d ago

Evaluation Results

Method
Gemini-1.5-Pro 2026.03	67.4	-	-	75	-
GPT-4o 2026.03	65.3	-	-	71.9	-
EgoR1 2026.03	64.9	-	-	-	-
Full 2026.03	63.78	81.11	71.44	72.11	-
FlashPrefill 2026.03	63.33	80.78	71.89	72	-
MInference 2026.03	62.89	79.89	70.89	71.22	-
FlexPrefill 2026.03	62.67	79.33	71	71.01	-
XAttention 2026.03	62.06	79.67	70.11	70.61	-
Open-o3 + MCoT 2026.03	60.3	-	-	69.7	-
V-CAST 2026.03	59.8	78.9	65.9	68.2	-
Qwen3-VL-8B 2026.04	59.1	79.9	67	68.7	-
VidCom2 2026.03	58.9	79.1	68	68.1	-
Motion-o 2026.03	58.6	-	-	67.5	-
VidCom2 2026.04	57.8	76.2	65	66.3	-
Open-o3 + MCoT 2026.03	57.3	-	-	66.3	-
Qwen3-VL-8B-Instruct 2026.03	57	76	60.4	64.5	-
VisionZip 2026.04	56.9	76.4	62.8	65.4	-
HoliTom 2026.03	56.2	73.6	63.9	64.6	-
VidCom2 2026.03	56.1	72.1	59.1	62.4	-
VisionZip 2026.03	56	70.7	61.3	62.7	-
KiToke 2026.04	56	77.6	63.9	65.8	-
VidCom2 2026.03	55.9	75.4	63.4	64.9	-
V-CAST 2026.03	55.9	71.9	58.3	62	-
Qwen3-VL-8B-Instruct 2026.03	55.8	78.8	66.2	66.9	-
V-CAST 2026.03	55.8	74.4	60.2	63.5	-
Motion-o 2026.03	55.5	-	-	64.2	-
VisionZip 2026.03	55.4	73.7	60.3	63.1	-
V-CAST 2026.03	55.3	76.8	63.2	65.1	-
FastVID 2026.03	55.2	70.3	61.6	62.4	-
Open-o3 Video 2026.03	54.9	-	-	63.6	-
VidCom2 2026.04	54.9	70.3	59.4	61.6	-
FastVID 2026.04	54.8	74.3	61.4	63.5	-
VidCom2 2026.03	54.7	72.6	61.3	62.9	-
PruneVID 2026.04	54.3	72.9	60.3	62.5	-
VisionZip 2026.03	54.2	69.6	56.7	60.1	-
DyCoke 2026.04	54.2	75.4	62.3	64	-
FlashVID 2026.03	54.1	72.4	57.6	61.4	-
FlashVID 2026.03	53.9	74.4	58.7	62.3	-
V-CAST 2026.03	53.8	76.3	61.4	63.9	-
FastVID 2026.02	53.6	74.7	60.1	62.8	-
FastVID 2026.04	53.4	75.2	62.6	63.7	-
Vanilla 2026.02	53.3	77	62.1	64.2	-
VisionZip 2026.02	53.3	72.3	59.6	61.7	-
Vanilla 2026.02	53.3	77	62.1	64.2	-
VidCom2 2026.03	53.3	68.9	56.7	59.6	-
KiToke 2026.04	53.3	69.8	56.7	59.9	-
FlashPrefill 2026.03	53.22	74.78	61.67	63.22	-
VISIONCOACH-7B 2026.03	53.2	-	-	63.3	-
HoliTom 2026.03	53.2	74.4	60.6	62.7	-
Full 2026.03	53.11	75.78	62.33	63.74	-
Open-o3-video-7B 2026.03	53.1	-	-	63.1	-
HoliTom 2026.03	53.1	71.4	54.6	59.7	-
FastVID 2026.04	53.1	71.1	58.8	61	-
LLaVA-Video-7B 2026.04	53.1	77.2	62.2	64.2	-
VisionZip 2026.02	52.9	74	60.3	62.4	-
VisionZip 2026.03	52.9	66.9	54.9	58.2	-
KiToke 2026.04	52.9	74.3	61.2	62.8	-
FastVID 2026.03	52.7	72	56.8	60.5	-
FastV 2026.04	52.7	73.2	61.7	62.5	-
FlexPrefill 2026.03	52.67	72.44	61.33	62.15	-
VisionZip 2026.03	52.6	70.3	58.4	60.4	-
FastVID 2026.02	52.3	74.6	60.8	62.6	-
FlashVID 2026.02	52.3	74.1	60	62.2	-
FastVID 2026.03	52.2	73.9	60.7	62.3	-
HoliTom 2026.03	52.2	72.3	58.2	60.9	-
VisionZip 2026.04	52.2	67.3	57.6	59	-
FlashVID 2026.02	52.1	73.8	59.6	61.8	-
FastVID 2026.03	52.1	72.2	57.2	60.5	-
VisionZip 2026.04	52.1	60.7	53.8	55.5	-
VisionZip 2026.02	51.9	72.9	58.1	61	-
FastVID 2026.02	51.8	73.4	58.1	61.1	-
VidCom2 2026.04	51.8	63.6	54.9	56.7	-
MInference 2026.03	51.78	71	61.89	61.56	-
HoliTom 2026.03	51.7	68.9	54.7	58.3	-
FlashVID 2026.02	51.6	74.2	61.4	62.4	-
FastV 2026.02	51.6	71.2	57.8	60.2	-
FastVID 2026.04	51.6	65	56.6	57.7	-
PruneVID 2026.04	51.3	65.6	53.6	56.8	-
FastVID 2026.04	51.3	71.2	59.3	60.6	-
VisionZip 2026.02	51.2	69.4	57.9	59.5	-
FlashVID 2026.02	51.2	72.2	59.1	60.9	-
FastV 2026.02	51.2	69.4	57	59.2	-
VisionZip 2026.02	51.2	70.7	57.9	59.9	-
FastV 2026.02	51.1	67.4	55.2	57.9	-
FastVID 2026.03	51.1	69.6	54.3	58.3	-
VisionZip 2026.04	51.1	73.8	59.4	61.4	-
VideoMTR 2026.03	51	-	-	59	-
KiToke 2026.04	51	74.6	60.8	62.1	-
FastV 2026.02	50.9	71.7	59.2	60.6	-
FastV 2026.02	50.8	67.9	56.9	58.5	-
EgoR1 2026.03	50.8	-	-	58.7	-
Qwen2.5-VL-7B 2026.03	50.8	-	-	62.4	-
Qwen2.5-VL-7B 2026.03	50.8	-	-	62.4	-
VideoRFT-7B 2026.03	50.7	-	-	59.8	-
VideoRFT-7B 2026.03	50.7	-	-	59.8	-
VideoR1-7B 2026.03	50.6	-	-	61.4	-
VideoR1-7B 2026.03	50.6	-	-	61.4	-
PruneVID 2026.04	50.3	72.4	56.9	59.9	-
FastVID 2026.02	50.2	71.8	57.3	59.8	-
VisionZip 2026.02	50.2	69.6	57.2	59	-

Showing 100 of 332 rows