Share your thoughts, 1 month free Claude Pro on usSee more

Video Reasoning on VBVR-Bench Out-of-Domain

61Average Score

VBVR-Wan2.2

Updated 22h ago

Evaluation Results

Method
VBVR-Wan2.2 2026.05	61	76.8	57.2	54.7	61.8	61.5
VideoRLVR 2026.05	60.2	65.5	62	59.7	58.8	58.2
Wan2.2-I2V-A14B 2026.05	32.9	40.5	30.8	34.3	23.6	30.7
CogVideoX1.5 2026.05	26.2	28.1	23.5	25	25.4	28.2
Human 2026.03	0.988	1	1	0.99	1	0.97
VBVR-Wan2.2-5B-Distilled + VLM-as-Teacher 2026.06	0.759	0.873	0.765	0.759	0.818	0.639
VBVR-Wan2.2 + CollabVR 2026.05	0.696	0.884	0.634	0.641	0.608	0.72
VBVR-Wan2.2-5B + Pass@5 2026.06	0.661	0.725	0.664	0.665	0.695	0.564
VBVR-Wan2.2-5B + Pass@4 2026.06	0.66	0.723	0.661	0.665	0.695	0.563
VBVR-Wan2.2-5B-Distilled + Pass@5 2026.06	0.653	0.709	0.603	0.651	0.728	0.582
VBVR-Wan2.2-5B + Pass@3 2026.06	0.652	0.72	0.66	0.65	0.682	0.56
VBVR-Wan2.2-5B-Distilled + Pass@4 2026.06	0.652	0.703	0.603	0.651	0.727	0.581
VBVR-Wan2.2 + Training-Free Ensemble 2026.03	0.65	0.803	0.705	0.531	0.639	0.716
VBVR-Wan2.2-5B + Pass@2 2026.06	0.65	0.718	0.659	0.647	0.68	0.559
VBVR-Wan2.2-5B-Distilled + Pass@3 2026.06	0.65	0.702	0.603	0.651	0.72	0.576
VBVR-Wan2.2-5B-Distilled + Pass@2 2026.06	0.647	0.701	0.603	0.651	0.707	0.575
VBVR-Wan2.2-5B-Distilled 2026.06	0.64	0.688	0.603	0.651	0.693	0.565
VBVR-Wan2.2-5B 2026.06	0.639	0.711	0.618	0.642	0.678	0.548
VBVR-Wan2.2-5B + VideoTPO 2026.06	0.629	0.703	0.604	0.631	0.669	0.538
VBVR-Wan2.2 + Pass@4 2026.05	0.622	0.785	0.66	0.535	0.577	0.683
VBVR-Wan2.2 2026.03	0.61	0.768	0.572	0.547	0.618	0.615
VBVR-Wan2.2 + Pass@2 2026.05	0.602	0.728	0.617	0.494	0.532	0.701
VBVR-Wan2.2-14B 2026.06	0.601	0.732	0.596	0.542	0.628	0.6
VBVR-Wan2.2-5B-Distilled + VideoTPO 2026.06	0.597	0.652	0.584	0.613	0.641	0.495
VBVR-Wan2.2 + VideoTPO 2026.05	0.582	0.767	0.619	0.513	0.54	0.572
VBVR-Wan2.2 2026.05	0.577	0.674	0.674	0.503	0.528	0.633
Sora 2 2026.03	0.523	0.546	0.472	0.525	0.462	0.546
Sora 2 2026.06	0.523	0.546	0.472	0.525	0.462	0.546
Veo 3.1 2026.03	0.429	0.577	0.277	0.42	0.441	0.404
Veo 3.1 2026.06	0.429	0.577	0.277	0.42	0.441	0.404
Runway Gen-4 Turbo 2026.03	0.414	0.515	0.429	0.419	0.327	0.373
Cosmos-Predict2.5 + CollabVR 2026.05	0.4	0.481	0.286	0.4	0.471	0.346
Kling 2.6 2026.03	0.33	0.528	0.135	0.272	0.356	0.359
Kling 2.6 2026.06	0.33	0.528	0.135	0.272	0.356	0.359
Wan2.2-I2V-A14B 2026.03	0.329	0.405	0.308	0.343	0.236	0.307
Cosmos-Predict2.5 2026.05	0.304	0.368	0.169	0.309	0.377	0.274
LTX-2 2026.03	0.297	0.244	0.337	0.317	0.231	0.311
HunyuanVideo-I2V 2026.03	0.265	0.175	0.369	0.29	0.253	0.25
CogVideoX1.5-5B-I2V 2026.03	0.262	0.281	0.235	0.25	0.254	0.282