Share your thoughts, 1 month free Claude Pro on usSee more

Video Understanding on Video-MME without subtitles

84.8Overall Score

Gemini-2.5-Pro

Updated 16d ago

Evaluation Results

Method
Gemini-2.5-Pro 2026.05	84.8	-	-	-	-	-	-
STEMO-Track 2026.05	76.8	85.8	78.3	66.2	-	-	-
Gemini-1.5-Pro 2026.02	75	81.7	74.3	67.4	-	-	-
Gemini 1.5 Pro 2026.03	75	-	-	67.4	-	-	-
Gemini-1.5-Pro 2026.05	75	81.7	74.3	67.4	-	-	-
Gemini-1.5-Pro 2026.06	75	81.7	74.3	67.4	-	-	-
STEMO-Track 2026.05	74.1	82.2	76	62.7	-	-	-
Qwen2.5-VL-72B 2026.05	73.3	-	-	-	-	-	-
GPT-4o 2026.02	71.9	80	70.3	65.3	-	-	-
GPT-4o 2026.03	71.9	-	-	65.3	-	-	-
GPT-4o 2026.05	71.9	-	-	-	-	-	-
GPT-4o 2026.05	71.9	80	70.3	65.3	-	-	-
GPT-4o 2026.06	71.9	80	70.3	65.3	-	-	-
VINO 2026.01	69.3	-	-	-	-	-	-
InternVL3-8B (pub.) 2026.05	66.3	-	-	-	-	-	-
LLaVA-OV 2026.05	66.3	76.7	62.2	60	-	-	-
VideoLLaMA3 2026.01	66.2	-	-	-	-	-	-
InternVL3.5 2026.01	65.4	-	-	-	-	-	-
FlashAttention 2025.12	65.3	75.1	66.7	54.2	-	-	-
Qwen2.5-VL 2026.01	65.1	-	-	-	-	-	-
MetaQuery-XL 2026.01	65.1	-	-	-	-	-	-
FlexPrefill 2025.12	65	74.6	66.8	53.7	-	-	-
UniSparse 2025.12	65	74.8	65.8	54.3	-	-	-
HIMMEL (Qwen3-VL) 2026.05	64.9	-	-	-	-	-	-
UniSparse 2025.12	64.6	74.4	65.9	53.3	-	-	-
VideoTemp-o3-7B-RL 2026.02	64.5	72.2	66.6	54.7	-	-	-
FlexPrefill 2025.12	64.4	73.9	65.8	53.7	-	-	-
XAttention 2025.12	63.9	74.1	64.7	52.8	-	-	-
HIMMEL (Qwen2.5-VL) 2026.05	63.5	-	-	-	-	-	-
Reflect-R1 2026.06	63.5	73.9	61	55.6	-	-	-
QViC-MF 2026.03	63.4	-	-	54	-	-	-
LLaVA-Video 2024.12	63.3	-	-	-	-	-	-
Qwen2-VL-Instruct 2024.12	63.3	-	-	-	-	-	-
LLaVA-Video 2026.03	63.3	-	-	-	-	-	-
LLaVA-Video 2026.05	63.3	-	-	-	-	-	-
XAttention 2025.12	63	73.6	63.6	51.9	-	-	-
TimeSearch-R-7B 2026.06	62.7	73.5	61.2	53.4	-	-	-
QViC-MF 2026.03	62.4	-	-	52.6	-	-	-
CARE 2026.06	62.3	-	-	-	-	-	-
VideoChat-R1-7B 2026.02	62.1	72.2	60.7	50.9	-	-	-
TASM 2026.06	61.5	68.6	60.9	55.1	-	-	-
T* (GPT-4o) 2026.06	61.45	72.1	60.3	52	-	-	-
Video-R1-7B 2026.02	61.4	74.1	61.1	51.2	-	-	-
Vision-R1-7B 2026.06	61.4	71.2	60.2	52.8	-	-	-
Qwen2.5-VL-7B-Instruct 2026.06	61.3	71.4	60.1	52.3	-	-	-
VL-Rethinker 2026.06	61.3	70.1	60.8	53	-	-	-
Flash-VStream 2026.03	61.2	-	-	50.3	-	-	-
Qwen2.5-VL (32 fr.) 2026.05	61.2	-	-	-	-	-	-
Video-LLaVA 2026.05	60.9	-	-	-	-	-	-
Video-R1-7B 2026.06	60.8	72.2	58.1	52.3	-	-	-
VideoTemp-o3-7B-SFT 2026.02	60.6	72	59.2	50.2	-	-	-
LongVU 2026.03	60.6	-	-	-	-	-	-
CARE 2026.06	60.6	-	-	-	-	-	-
MLoC 2026.06	60.3	68.5	60.2	53.4	-	-	-
VILA-1.5-40B 2026.02	60.1	-	-	-	-	-	-
EMLoC 2026.06	60.1	68.2	59.8	49.5	-	-	-
VILA-1.5-40B 2026.06	60.1	-	-	-	-	-	-
LLaVA-Video-7B 2026.07	59.96	-	-	-	-	-	100
Qwen2.5-VL-7B 2026.02	59.9	69.8	59.2	50.8	-	-	-
StreamingTOM 2025.10	59.9	71.3	57.8	50.6	-	-	-
VideoRFT-7B 2026.02	59.8	-	-	-	-	-	-
LLaVA-OV-7B + StreamMem 2025.10	59.4	71.5	56.6	50.1	-	-	-
FastV 2026.07	59.26	-	-	-	-	-	97.7
VILA-1.5 2024.06	59	68.1	58.1	50.8	-	-	-
Video-MTR-7B 2026.02	59	-	-	51	-	-	-
LLaVA-OV-7B + HoliTom 2025.10	58.9	-	-	-	-	-	-
LLaVA-OneVision 2025.12	58.5	70.1	56.4	48.9	-	-	-
LLaVA-OV-7B 2025.10	58.4	70.1	56.4	48.8	-	-	-
LLaVA-OV-7B 2025.10	58.4	70.1	56.4	48.8	-	-	-
LLAVA-OV 2024.12	58.2	-	-	-	-	-	-
LLaVA-OV-7B + VisionZip 2025.10	58.2	-	-	-	-	-	-
LLaVA-OneVision-7B 2026.06	58.2	-	-	-	-	-	-
AnchorPrune 2026.07	58.19	-	-	-	-	-	98.3
CDPruner 2026.07	57.85	-	-	-	-	-	96.8
Temporal-RLT 2026.06	57.6	-	-	-	-	-	-
Frame-Voyager 2026.03	57.5	-	-	48.9	-	-	-
show-o2 2026.01	57.4	-	-	-	-	-	-
TimeMaker-8B 2026.02	57.3	-	-	46.4	-	-	-
LLaVA-OV-7B + LiveVLM 2025.10	57.3	66.7	56.4	48.8	-	-	-
CARE 2026.06	57.3	-	-	-	-	-	-
DivPrune 2026.07	57	-	-	-	-	-	96.1
Dispider-7B 2025.10	56.5	-	53.7	49.7	-	-	-
FastV 2026.07	56.37	-	-	-	-	-	92.4
AnchorPrune 2026.07	56.26	-	-	-	-	-	94.1
Kangeroo-8B 2026.06	56	-	-	-	-	-	-
VideoAgent (GPT-4) 2026.06	56	-	-	49	-	-	-
DivPrune 2026.07	55.89	-	-	-	-	-	93.4
VideoXL-7B 2026.02	55.5	-	-	-	-	-	-
Video-XL 2026.03	55.5	-	-	-	-	-	-
LLaVA-OV-7B + DyCoke 2025.10	54.3	-	-	-	-	-	-
Video-R1-7B 2026.06	54.3	-	-	-	-	-	-
CDPruner 2026.07	54.22	-	-	-	-	-	91.7
VideoChat2 2026.05	54.1	-	-	-	-	-	-
InternVL2 2024.12	54	-	-	-	-	-	-
LLaVA-NeXT-INST-IT 2024.12	54	-	-	-	-	-	-
Qwen2-VL + SF2T 2025.04	53.6	-	-	-	-	-	-
MiniCPM-V 2.6 + SF2T 2025.04	53.19	-	-	-	-	-	-
Qwen2.5-VL-7B 2026.06	52.8	-	-	-	-	-	-
LongVA 2024.06	52.6	61.1	50.4	46.2	-	-	-
LongVA-7B 2026.02	52.6	61.1	50.4	46.2	-	-	-

Showing 100 of 199 rows