Share your thoughts, 1 month free Claude Pro on usSee more

Video Understanding on Video-MME without subtitles

75Overall Score

Gemini-1.5-Pro

Updated 1mo ago

Evaluation Results

Method
Gemini-1.5-Pro 2026.02	75	81.7	74.3	67.4	-	-
Gemini 1.5 Pro 2026.03	75	-	-	67.4	-	-
GPT-4o 2026.02	71.9	80	70.3	65.3	-	-
GPT-4o 2026.03	71.9	-	-	65.3	-	-
VINO 2026.01	69.3	-	-	-	-	-
VideoLLaMA3 2026.01	66.2	-	-	-	-	-
InternVL3.5 2026.01	65.4	-	-	-	-	-
FlashAttention 2025.12	65.3	75.1	66.7	54.2	-	-
Qwen2.5-VL 2026.01	65.1	-	-	-	-	-
MetaQuery-XL 2026.01	65.1	-	-	-	-	-
FlexPrefill 2025.12	65	74.6	66.8	53.7	-	-
UniSparse 2025.12	65	74.8	65.8	54.3	-	-
UniSparse 2025.12	64.6	74.4	65.9	53.3	-	-
VideoTemp-o3-7B-RL 2026.02	64.5	72.2	66.6	54.7	-	-
FlexPrefill 2025.12	64.4	73.9	65.8	53.7	-	-
XAttention 2025.12	63.9	74.1	64.7	52.8	-	-
QViC-MF 2026.03	63.4	-	-	54	-	-
LLaVA-Video 2024.12	63.3	-	-	-	-	-
Qwen2-VL-Instruct 2024.12	63.3	-	-	-	-	-
LLaVA-Video 2026.03	63.3	-	-	-	-	-
XAttention 2025.12	63	73.6	63.6	51.9	-	-
QViC-MF 2026.03	62.4	-	-	52.6	-	-
VideoChat-R1-7B 2026.02	62.1	72.2	60.7	50.9	-	-
Video-R1-7B 2026.02	61.4	74.1	61.1	51.2	-	-
Flash-VStream 2026.03	61.2	-	-	50.3	-	-
VideoTemp-o3-7B-SFT 2026.02	60.6	72	59.2	50.2	-	-
LongVU 2026.03	60.6	-	-	-	-	-
VILA-1.5-40B 2026.02	60.1	-	-	-	-	-
Qwen2.5-VL-7B 2026.02	59.9	69.8	59.2	50.8	-	-
StreamingTOM 2025.10	59.9	71.3	57.8	50.6	-	-
VideoRFT-7B 2026.02	59.8	-	-	-	-	-
LLaVA-OV-7B + StreamMem 2025.10	59.4	71.5	56.6	50.1	-	-
VILA-1.5 2024.06	59	68.1	58.1	50.8	-	-
Video-MTR-7B 2026.02	59	-	-	51	-	-
LLaVA-OV-7B + HoliTom 2025.10	58.9	-	-	-	-	-
LLaVA-OneVision 2025.12	58.5	70.1	56.4	48.9	-	-
LLaVA-OV-7B 2025.10	58.4	70.1	56.4	48.8	-	-
LLaVA-OV-7B 2025.10	58.4	70.1	56.4	48.8	-	-
LLAVA-OV 2024.12	58.2	-	-	-	-	-
LLaVA-OV-7B + VisionZip 2025.10	58.2	-	-	-	-	-
Frame-Voyager 2026.03	57.5	-	-	48.9	-	-
show-o2 2026.01	57.4	-	-	-	-	-
TimeMaker-8B 2026.02	57.3	-	-	46.4	-	-
LLaVA-OV-7B + LiveVLM 2025.10	57.3	66.7	56.4	48.8	-	-
Dispider-7B 2025.10	56.5	-	53.7	49.7	-	-
VideoXL-7B 2026.02	55.5	-	-	-	-	-
Video-XL 2026.03	55.5	-	-	-	-	-
LLaVA-OV-7B + DyCoke 2025.10	54.3	-	-	-	-	-
InternVL2 2024.12	54	-	-	-	-	-
LLaVA-NeXT-INST-IT 2024.12	54	-	-	-	-	-
Qwen2-VL + SF2T 2025.04	53.6	-	-	-	-	-
MiniCPM-V 2.6 + SF2T 2025.04	53.19	-	-	-	-	-
LongVA 2024.06	52.6	61.1	50.4	46.2	-	-
LongVA-7B 2026.02	52.6	61.1	50.4	46.2	-	-
LongVA 2026.03	52.6	-	-	46.2	-	-
LongVA 2024.06	52.4	61.4	50.9	45	-	-
LLaVA-NeXT-Video-34B 2024.06	52	61.7	50.1	44.3	-	-
VideoLLaMA 2.1 + SF2T 2025.04	51.88	-	-	-	-	-
LongVA 2024.06	51.8	61.1	48.8	45.4	-	-
LongVA 2024.06	51.8	60.3	48.9	46.1	-	-
InternVL-Chat-V1.5 2024.06	50.7	60.2	46.4	45.6	-	-
LongVA 2024.06	49.7	59	46.6	43.6	-	-
LLaVA-NeXT-Qwen2 2024.06	49.5	58	47	43.4	-	-
VideoLLaMA 2.1 2025.04	49.02	-	-	-	-	-
VideoLLaMA2 2024.06	47.9	56	45.4	42.1	-	-
LongVA 2024.06	47.9	55.1	46.3	42.1	-	-
VideoLLaMA2 2025.12	47.9	56	45.4	42.1	-	-
LLaVA-Next-Video 2024.12	46.5	-	-	-	-	-
LLaVA-NeXT-INST-IT 2024.12	44.3	-	-	-	-	-
DynFocus 2026.03	44.1	-	-	37.7	-	-
Qwen2-VL 2025.04	43.77	-	-	-	-	-
VideoScaffold 2025.12	43.3	47.2	43.6	39.2	-	-
MiniCPM-V 2.6 2025.04	43.17	-	-	-	-	-
Qwen-VL-Chat 2024.06	41.1	46.9	38.7	37.8	-	-
Chat-UniVi-V1.5 2024.06	40.6	45.7	40.3	35.8	-	-
Chat-UniVi 2025.12	40.6	45.7	40.3	35.8	-	-
Video-LLaVA 2024.06	39.9	45.3	38	36.2	-	-
Video-LLaVA 2025.12	39.9	45.3	38	36.2	-	-
VideoChat2-Mistral 2024.06	39.5	48.3	37	33.2	-	-
VideoChat2 2025.12	39.5	48.3	36.3	35	-	-
LLaVA-SFT + Ours 2025.12	39.4	42.1	38.4	37.7	-	-
MovieChat-7B 2025.10	38.2	-	-	33.4	-	-
ST-LLM 2024.06	37.9	45.7	36.8	31.3	-	-
LLaVA-NeXT 2024.12	36.2	-	-	-	-	-
LLaVA-SFT 2025.12	35.5	40.2	34	32.3	-	-
LLaVA-NeXT-Video + SF2T 2025.04	34.84	-	-	-	-	-
LLaVA-NeXT-Video 2025.04	29.76	-	-	-	-	-
LLaMA-VID 2025.12	25.9	-	-	-	-	-
LLaMA-VID 2026.03	25.9	-	-	-	-	-
MiniCPM-V 2 2024.10	-	-	-	-	38.6	-
InternVL2-2B 2024.10	-	-	-	-	45.9	-
Qwen2-VL-2B-Instruct 2024.10	-	-	-	-	55.6	-
Aquila-VL-2B 2024.10	-	-	-	-	48.4	-
Aquila-VL-2B 2024.10	-	-	-	-	51.5	-
GPT-4o 2024.12	-	-	-	-	-	71.9
GPT-4V 2024.12	-	-	-	-	-	59.9
LLaVA-OV-72B 2024.12	-	-	-	-	-	64.8
LLaVA-OV-72B 2024.12	-	-	-	-	-	66.2
InternVL-2-8B 2024.12	-	-	-	-	-	54
Qwen2-VL-7B-Ins. 2024.12	-	-	-	-	-	63.3

Showing 100 of 137 rows