Share your thoughts, 1 month free Claude Pro on usSee more

Video Understanding on VideoMME (Length Segmentation)

75Score (Overall)

Gemini-1.5-Pro

Updated 1d ago

Evaluation Results

Method
Gemini-1.5-Pro 2026.03	75	-	-	67.4	-
Gemini-1.5-pro 2026.05	75	81.7	74.3	67.4	-
Full 2026.03	72.11	81.11	71.44	63.78	-
FlashPrefill 2026.03	72	80.78	71.89	63.33	-
GPT-4o 2026.03	71.9	-	-	-	-
GPT-4o 2026.03	71.9	-	-	-	-
GPT-4o 2026.03	71.9	-	-	65.3	-
GPT-4o 2026.05	71.9	80	70.3	65.3	-
MInference 2026.03	71.22	79.89	70.89	62.89	-
FlexPrefill 2026.03	71.01	79.33	71	62.67	-
XAttention 2026.03	70.61	79.67	70.11	62.06	-
Open-o3 + MCoT 2026.03	69.7	-	-	60.3	-
Qwen3-VL-8B 2026.04	68.7	79.9	67	59.1	-
V-CAST 2026.03	68.2	78.9	65.9	59.8	-
VidCom2 2026.03	68.1	79.1	68	58.9	-
Motion-o 2026.03	67.5	-	-	58.6	-
MI-Pruner 2026.05	67.1	77.4	66.8	57.1	-
Qwen3-VL-8B-Instruct 2026.03	66.9	78.8	66.2	55.8	-
EchoPrune 2026.05	66.7	75.2	67.8	57.1	-
VisionZip 2026.05	66.5	77.2	65.9	56.5	-
Full Tokens 2026.05	66.44	77.1	66.8	55.4	-
OmniSelect 2026.05	66.33	74.9	67.7	56.4	-
Open-o3 + MCoT 2026.03	66.3	-	-	57.3	-
VidCom2 2026.04	66.3	76.2	65	57.8	-
Video-LLaMA3-7B 2026.05	66.2	80.1	63.7	54.9	-
LongVT-RL-7B 2026.03	66.1	-	-	-	-
OmniZip 2026.05	66.03	75.4	67.2	55.4	-
FlashVID 2026.05	65.9	77	65.7	55.1	-
KiToke 2026.04	65.8	77.6	63.9	56	-
OmniZip 2026.05	65.48	73.8	66.3	56.3	-
OmniSelect 2026.05	65.48	73.8	66.3	56.3	-
VisionZip 2026.04	65.4	76.4	62.8	56.9	-
DyCoke (V&A) 2026.05	65.15	73.9	66.4	55.1	-
V-CAST 2026.03	65.1	76.8	63.2	55.3	-
Random 2026.05	65.07	73.9	66.6	55.3	-
VidCom2 2026.03	64.9	75.4	63.4	55.9	-
InternVL-V3.5-8B 2026.05	64.7	77.4	63.1	53.4	-
HoliTom 2026.03	64.6	73.6	63.9	56.2	-
Qwen3-VL-8B-Instruct 2026.03	64.5	76	60.4	57	-
Vanilla 2026.02	64.2	77	62.1	53.3	-
Vanilla 2026.02	64.2	77	62.1	53.3	-
Motion-o 2026.03	64.2	-	-	55.5	-
LLaVA-Video-7B 2026.04	64.2	77.2	62.2	53.1	-
InternVL-V2.5-8B 2026.05	64.2	-	-	-	-
LLaVA-Video 7B 2026.05	64.1	76.9	-	53.4	-
DyCoke 2026.04	64	75.4	62.3	54.2	-
OmniSelect 2026.05	63.93	73.4	65	53.3	-
V-CAST 2026.03	63.9	76.3	61.4	53.8	-
Full Tokens 2026.05	63.89	74.8	64.1	52.8	-
Qwen3VL-8B 2026.05	63.8	75	59.8	56.6	-
ST-SimDiff 2026.05	63.8	76.2	62.4	52.7	-
Full 2026.03	63.74	75.78	62.33	53.11	-
OmniZip 2026.05	63.74	74	64.6	52.7	-
FastVID 2026.04	63.7	75.2	62.6	53.4	-
Open-o3 Video 2026.03	63.6	-	-	54.9	-
V-CAST 2026.03	63.5	74.4	60.2	55.8	-
FastVID 2026.04	63.5	74.3	61.4	54.8	-
EvoStreaming-8B-InternVL-V3.5 2026.05	63.5	76.7	62	51.9	-
VISIONCOACH-7B 2026.03	63.3	-	-	53.2	-
LLaVA-Video-7B 2026.05	63.3	-	-	-	-
LLaVA-Video 2026.05	63.3	-	-	-	-
FlashPrefill 2026.03	63.22	74.78	61.67	53.22	-
Qwen2.5-VL-7B 2025.08	63.2	-	-	50.4	-
ST-SimDiff 2026.05	63.2	74.7	61.9	53	-
Open-o3-video-7B 2026.03	63.1	-	-	53.1	-
VisionZip 2026.03	63.1	73.7	60.3	55.4	-
VidCom2 2026.03	62.9	72.6	61.3	54.7	-
StreamAgent-7B 2025.08	62.9	-	-	50.6	-
FastVID 2026.02	62.8	74.7	60.1	53.6	-
KiToke 2026.04	62.8	74.3	61.2	52.9	-
HoliTom 2026.03	62.7	74.4	60.6	53.2	-
VisionZip 2026.03	62.7	70.7	61.3	56	-
FastVID 2026.02	62.6	74.6	60.8	52.3	-
FrameFusion 2026.05	62.6	74.6	61.2	52	-
PruneVID 2026.04	62.5	72.9	60.3	54.3	-
FastV 2026.04	62.5	73.2	61.7	52.7	-
TimeChat-Online-7B 2025.08	62.5	-	-	49.2	-
VisionZip 2026.02	62.4	74	60.3	52.9	-
FlashVID 2026.02	62.4	74.2	61.4	51.6	-
Qwen2.5-VL-7B 2026.03	62.4	-	-	50.8	-
Qwen2.5-VL-7B 2026.03	62.4	-	-	50.8	-
VidCom2 2026.03	62.4	72.1	59.1	56.1	-
FastVID 2026.03	62.4	70.3	61.6	55.2	-
FastVID 2026.03	62.3	73.9	60.7	52.2	-
FlashVID 2026.03	62.3	74.4	58.7	53.9	-
FlashVID 2026.02	62.2	74.1	60	52.3	-
FastV 2026.05	62.2	73.9	61.4	51.3	-
FlexPrefill 2026.03	62.15	72.44	61.33	52.67	-
DyCoke (V&A) 2026.05	62.11	71.1	62.8	52.4	-
KiToke 2026.04	62.1	74.6	60.8	51	-
DynaTok 2026.05	62.1	74.1	-	51.6	-
V-CAST 2026.03	62	71.9	58.3	55.9	-
Qwen2.5-VL-7B 2026.05	62	73	60.9	52.1	-
EvoStreaming-8B-Qwen2.5 2026.05	61.9	73.1	61	51.4	-
FlashVID 2026.02	61.8	73.8	59.6	52.1	-
VisionZip 2026.02	61.7	72.3	59.6	53.3	-
FasterVLM 2026.05	61.7	74	59.2	51.8	-
VidCom2 2026.04	61.6	70.3	59.4	54.9	-
DyCoke 2026.05	61.6	74.6	-	51.1	-
OmniSelect 2026.05	61.59	69.7	61.9	53.2	-

Showing 100 of 441 rows