Share your thoughts, 1 month free Claude Pro on usSee more

Video Question Answering on LongVideoBench (val)

83Accuracy

HAVEN

Updated 22d ago

Evaluation Results

Method
HAVEN 2026.01	83	-	-	-	-	-
HAVEN 2026.01	81	-	-	-	-	-
Seed1.5-VL-Thinking-200B 2026.01	74	-	-	-	-	-
GPT-5.4 (ref.) 2026.05	72.5	-	-	-	-	-
DVD 2026.01	71.6	-	-	-	-	-
Gemini-3-Pro (ref.) 2026.05	71	-	-	-	-	-
Qwen3.5-397B-A17 (ref.) 2026.05	70.5	-	-	-	-	-
DVD 2026.01	68.6	-	-	-	-	-
Qwen3.5-122B-A10B (ref.) 2026.05	68	-	-	-	-	-
OpenAI o3 2026.01	67.5	-	-	-	-	-
AdaReTake 2026.01	67	-	-	-	-	-
GPT-4o 2026.01	66.7	-	-	-	-	-
GPT-4o 2026.03	66.7	-	-	-	-	-
GPT-4o 2026.04	66.7	60.02	-	-	-	-
GPT-4o 2026.05	66.7	-	-	-	-	-
T* 2026.05	65.4	-	-	-	-	-
Qwen-2.5-VL 2026.04	65.1	48.82	-	-	-	-
MIRA 2026.05	64.5	-	-	-	-	-
Gemini-1.5-Pro 2026.05	64	-	-	-	-	-
A.I.R. + InternVL-3 2025.10	62.8	-	-	-	-	-
HY-Himmel 2026.05	62.5	-	-	-	-	-
LLaVA-Video + EFS 2026.03	62.1	-	-	-	-	-
Gemini 1.5 Flash 2026.04	61.6	-	-	-	-	-
Gemini-1.5-Flash 2026.05	61.6	-	-	-	-	-
TTA-Vid 2026.04	61.48	55.13	-	-	-	-
A.I.R. + QwenVL-2.5 2025.10	61.4	-	-	-	-	-
GPT-4V 2026.05	61.3	-	-	-	-	-
HY-Himmel 2026.05	61	-	-	-	-	-
GPT-4o 2026.01	60.9	-	-	-	-	-
InternVL-3 + MDP3 2025.10	60.9	-	-	-	-	-
Qwen2.5-VL-72B 2026.01	60.7	-	-	-	-	-
A.I.R. + LLaVA-OneVision 2025.10	60.7	-	-	-	-	-
OpenAI o3 2026.01	60.6	-	-	-	-	-
Qwen2.5-VL + EFS 2026.03	60.5	-	-	-	-	-
LLaVA-OneVision + EFS 2026.03	60.3	-	-	-	-	-
CATS (ours)† 2026.05	60.21	-	-	-	-	-
TPO 2026.05	60.1	-	-	-	-	-
QwenVL-2.5 + MDP3 2025.10	60	-	-	-	-	-
HY-Himmel 2026.05	59.9	-	-	-	-	-
AKS† 2026.05	59.76	-	-	-	-	-
LLaVA-OneVision + BOLT 2025.10	59.6	-	-	-	-	-
DToMA 2026.05	59.6	-	-	-	-	-
BIMBA 2026.05	59.5	-	-	-	-	-
LLaVA-OneVision + AKS 2025.10	59.3	-	-	-	-	-
Video-R2 2026.04	59.2	53.92	-	-	-	-
InternVL-3 2026.04	59.08	51.37	-	-	-	-
LLaVA-OneVision + MDP3 2025.10	59	-	-	-	-	-
InternVL3-8B 2026.05	58.9	-	-	-	-	-
LLaVA-Video 2026.03	58.8	-	-	-	-	-
InternVL-3 (reported) 2025.10	58.8	-	-	-	-	-
Apollo 2026.05	58.5	-	-	-	-	-
InternVL-3 (reproduced) 2025.10	58.3	-	-	-	-	-
LLaVA-Video 2026.05	58.2	-	-	-	-	-
QwenVL-2.5 (reproduced) 2025.10	58.1	-	-	-	-	-
TTA-Vid 2026.04	57.81	51.84	-	-	-	-
NVILA 2026.03	57.7	-	-	-	-	-
Video-R1 2026.04	57.6	51.94	-	-	-	-
Qwen2.5-VL-7B 2026.05	57.4	-	-	-	-	-
LongVILA 2026.05	57.1	-	-	-	-	-
TTRV* 2026.04	57.07	50.46	-	-	-	-
Qwen2.5-VL 2026.03	57	-	-	-	-	-
Video-RFT 2026.04	57	52.32	-	-	-	-
LLaVA-OneVision (reproduced) 2025.10	56.6	-	-	-	-	-
Video-RTS 2026.04	56.6	-	-	-	-	-
LLaVA-OneVision (reported) 2025.10	56.4	-	-	-	-	-
LLaVA-OneVision 2026.04	56.3	43.27	-	-	-	-
LLaVA-Video-7B 2026.05	56.2	-	-	-	-	-
LiveVLM 2025.05	56.1	-	-	-	-	-
LLaVA-OneVision-7B + ReKV 2025.05	55.8	-	-	-	-	-
LLaVA-OneVision-7B 2025.05	55.6	-	-	-	-	-
MiniCPM-V 2.6 2026.05	54.9	-	-	-	-	-
LLaVA-OneVision-7B + StreamMem 2025.05	54.4	-	-	-	-	-
VideoChat-R1 2026.04	54.3	52.34	-	-	-	-
Kangaroo-8B 2025.05	54.2	-	-	-	-	-
LLaVA-OneVision 2026.03	54.1	-	-	-	-	-
VideoChat-R1.5 2026.04	53.6	52.24	-	-	-	-
PLLaVA 2026.05	53.2	-	-	-	-	-
A.I.R. + VILA-1.5 2025.10	52.9	-	-	-	-	-
VILA-1.5 + MDP3 2025.10	52.3	-	-	-	-	-
VILA-1.5 + Q-Frame 2025.10	51.6	-	-	-	-	-
Video-XL 2026.03	50.7	-	-	-	-	-
VILA-1.5 (reproduced) 2025.10	47.9	-	-	-	-	-
VILA-1.5 (reported) 2025.10	47.1	-	-	-	-	-
QwenVL-2.5 (reported) 2025.10	45.3	-	-	-	-	-
Video-LLaVA 2026.03	39.1	-	-	-	-	-
Video-LLaVA 2026.05	39.1	-	-	-	-	-
Random 2026.04	20	17.8	-	-	-	-
VideoChat2 2024.08	-	36	-	-	-	-
ShareGPT4Video 2024.08	-	39.7	-	-	-	-
PLLAVA 2024.08	-	40.2	-	-	-	-
Idefics2 2024.08	-	49.7	-	-	-	-
Mantis-SigLIP 2024.08	-	47	-	-	-	-
mPLUG-Owl3 2024.08	-	52.1	-	-	-	-
GPT-4o 2025.12	-	66.7	71.6	76.8	66.7	61.6
GPT-4o 2025.12	-	52.6	60.7	62.4	50.1	49
Gemini 1.5 Pro 2025.12	-	64	-	-	-	-
Qwen2.5-VL 2025.12	-	53.7	59	65.6	52.9	48.8
InternVL3 2025.12	-	48.9	54.7	66.9	46.1	44
STAR 2025.12	-	57.2	63.6	68	56.8	52.3