Share your thoughts, 1 month free Claude Pro on usSee more

Streaming Video Understanding on OVOBench Realtime

93.2Average Score

Human

Updated 1mo ago

Evaluation Results

Method
Human 2026.03	93.2	94	92.6	94.8	92.7	91.1	94
Streamo-4B 2025.12	72.2	-	-	-	-	-	-
Gemini-1.5-pro 2025.12	69.3	-	-	-	-	-	-
Gemini 1.5 Pro 2026.03	69.3	85.9	67	79.3	58.4	63.4	62
FluxMem 2026.03	67.2	81.2	59.6	70.7	53.4	75.2	63
Qwen3-VL-4B 2025.12	66.5	-	-	-	-	-	-
ViSpeak 2026.03	66.3	75.2	58.7	71.6	51.1	74.3	66.9
Streamo-7B 2025.12	66	-	-	-	-	-	-
CausalMem 2026.06	65.7	71.8	61.5	76.7	48.9	76.2	66.8
GPT-4o 2025.12	64.5	-	-	-	-	-	-
GPT-4o 2026.03	64.5	69.8	64.2	71.6	51.1	70.3	59.8
LLaVA-OneVision 2026.03	64	66.4	57.8	73.3	53.4	71.3	62
VisionZip 2026.06	63.7	68.5	55	77.6	48.3	74.3	65.2
StreamingTom 2026.06	63.6	67.8	61.5	75.9	47.8	68.3	66.3
LLaVA-Video 2026.03	63.5	69.1	58.7	68.8	49.4	74.3	59.8
Qwen2.5-VL† 2026.03	63.3	79.2	53.2	67.2	51.7	71.3	57.1
LLaVA-OneVision 2026.06	62.6	67.1	61.5	74.1	45.5	69.3	65.2
StreamingVLM-7B 2025.12	62	-	-	-	-	-	-
LiveVLM 2026.06	61.6	67.1	60.5	70.7	46.1	71.3	61.9
Streamo-3B 2025.12	61.5	-	-	-	-	-	-
TimeChat-Online 2026.03	61.4	74.5	48.6	68.1	48.3	69.3	59.8
StreamForest 2026.03	61.2	68.5	53.2	71.6	47.8	65.4	60.9
Streamo-2B 2025.12	61.1	-	-	-	-	-	-
InternVL2 2026.03	60.4	67.1	60.6	63.8	46.1	68.3	56.5
InternVL3-2B 2025.12	59.5	-	-	-	-	-	-
Qwen2.5-VL-7B 2025.12	58.8	-	-	-	-	-	-
LongVU 2026.03	57.4	55.7	49.5	59.5	48.3	68.3	63
ReKV 2026.06	57.3	-	-	-	-	-	-
Dispider-7B 2025.12	54.6	-	-	-	-	-	-
Qwen2.5-VL-3B 2025.12	54.6	-	-	-	-	-	-
Dispider 2026.03	54.6	57.7	49.5	62.1	44.9	61.4	51.6
Flash-VStream-7B 2025.12	28.4	-	-	-	-	-	-
Flash-VStream 2026.03	28.4	24.2	29.4	28.5	33.7	25.7	28.8
Flash-VStream-7B 2026.01	28.37	24.16	29.36	28.45	33.71	25.74	28.8
Event-VStream 2026.01	28.15	24.38	29.36	27.59	25.09	33.66	28.8
VideoLLM-online-8B 2025.12	20.8	-	-	-	-	-	-
VideoLLM-Online 2026.03	20.8	8.1	23.9	12.1	14	45.5	21.2
VideoLLM-online-8B 2026.01	17.73	8.05	23.85	12.07	14.04	45.54	18.8