Share your thoughts, 1 month free Claude Pro on usSee more

Streaming Video Understanding on OVO-Bench

95.3OCR

SIMPLESTREAM (Qwen2.5-VL-7B + 8f)

Updated 16d ago

Evaluation Results

Method
SIMPLESTREAM (Qwen2.5-VL-7B + 8f) 2026.04	95.3	67.9	79.3	61.2	74.3	81.5	76.6	52.2	63.5	36.6	50.8	-	63.7
Human 2026.04	94	92.6	94.8	92.7	91.1	94	93.2	92.6	93	91.4	92.3	-	92.77
SIMPLESTREAM (Qwen2.5-VL-7B + 4f) 2026.04	94	72.5	80.2	68	76.2	79.3	78.4	54.5	60.8	40.3	51.9	-	65.13
SIMPLESTREAM (Qwen3-VL-8B + 4f) 2026.04	94	85.3	82.8	65.7	77.2	83.2	81.4	51.9	58.1	52.1	54	-	67.7
SIMPLESTREAM (Qwen3-VL-8B + 8f) 2026.04	94	84.4	80.2	64	75.3	81.5	79.9	53.2	60.8	50.5	54.9	-	67.37
SIMPLESTREAM (Qwen3-VL-8B + 2f) 2026.04	89.3	77.1	83.6	68.5	76.2	81	79.3	49.5	56.1	54.8	53.5	-	66.38
SIMPLESTREAM (Qwen2.5-VL-7B + 2f) 2026.04	88.6	67	81	64.6	69.3	79.3	75	49.2	56.8	42.5	49.5	-	62.22
ThinkStream-3B 2026.03	85.23	64.22	69.82	49.43	69.31	64.13	67.03	53.87	59.46	43.55	52.3	59.66	-
HERMES-7B† 2026.04	85.2	64.2	71.6	53.4	74.3	65.2	69	48.5	62.2	37.6	49.4	-	59.2
Streamo-7B 2026.04	79.2	57.8	75	49.4	64.4	70.1	66	54.6	52	31.7	46.1	-	56.05
Streamo-3B 2026.03	78.52	52.29	67.24	44.38	55.45	71.2	61.51	51.18	57.43	16.67	41.76	51.64	-
Qwen2.5-VL-32B 2026.03	77.18	58.72	68.1	50.56	74.26	57.61	64.4	58.59	62.84	29.57	50.33	57.37	-
Qwen2.5-VL-3B 2026.03	76.51	44.03	67.24	42.13	68.31	61.96	60.03	50.5	53.38	22.04	41.98	51	-
TimeChat-Online-7B 2026.04	75.2	46.8	70.7	47.8	69.3	61.4	61.9	55.9	59.5	9.7	41.7	-	51.8
LLaVA-Video-7B 2026.03	69.13	58.72	68.83	49.44	74.26	59.78	63.52	56.23	57.43	7.53	40.4	51.96	-
LLaVA-Video-7B 2026.04	69.1	58.7	68.8	49.4	74.3	59.8	63.5	56.2	57.4	7.5	40.4	-	51.95
Qwen2-VL-7B 2026.04	69.1	53.2	63.8	50.6	66.3	60.9	60.7	44.4	66.9	34.4	48.6	-	54.62
StreamForest-7B 2026.04	68.5	53.2	71.6	47.8	65.4	60.9	61.2	58.9	64.9	32.3	52	-	56.6
StreamForest-7B 2026.03	68.46	53.21	71.55	47.75	65.35	60.87	61.2	58.92	64.86	32.26	52.02	56.61	-
Qwen2.5-VL-7B 2026.04	67.8	55.1	67.2	42.1	66.3	60.9	59.9	51.5	58.8	23.7	44.7	-	52.28
Qwen2.5-VL-7B 2026.03	67.79	55.05	67.24	42.13	66.34	60.87	59.9	51.52	58.78	23.66	44.65	52.28	-
InternVL2-8B 2026.04	67.1	60.6	63.8	46.1	68.3	56.5	60.4	48.2	57.4	24.7	43.4	-	51.9
LLaVA-OneVision-7B 2026.04	66.4	57.8	73.3	53.4	71.3	62	64	54.2	55.4	21.5	43.7	-	53.85
Qwen2-VL-7B 2026.03	60.4	50.46	56.03	47.19	66.34	55.43	55.98	47.81	35.48	56.08	46.46	51.22	-
Dispider-7B 2026.03	57.72	49.54	62.07	44.94	61.39	51.63	54.55	48.48	55.41	4.3	36.06	45.31	-
Dispider-7B 2026.04	57.7	49.5	62.1	44.9	61.4	51.6	54.6	48.5	55.4	4.3	36.1	-	45.35
LongVU-7B 2026.04	55.7	49.5	59.5	48.3	68.3	63	57.4	43.1	66.2	9.1	39.5	-	48.45
LongVU-7B 2026.03	53.69	53.21	62.93	47.75	68.32	59.78	57.61	40.74	59.46	4.84	35.01	46.31	-
Flash-VStream-7B 2026.04	24.2	29.4	28.5	33.7	25.7	28.8	28.4	39.1	37.2	5.9	27.4	-	27.9
Flash-VStream-7B 2026.03	24.16	29.36	28.45	33.71	25.74	28.8	28.37	39.06	37.16	5.91	27.38	27.88	-
VideoLLM-online-8B 2026.04	8.1	23.9	12.1	14	45.5	21.2	20.8	22.2	18.8	12.2	17.7	-	19.26
VideoLLM-online-8B 2026.03	8.05	23.85	12.07	14.04	45.54	21.2	20.79	22.22	18.8	12.18	17.73	19.26	-