Long-video understanding on LVBench (test)

71.8LVBench Score

Symphony

Updated 1mo ago

Evaluation Results

Method	Links
Symphony 2026.03		71.8
DVD 2026.03		66.8
Qwen3-VL-235B-A22B 2026.03		63.6
MR. Video 2026.03		60.8
Seed 1.6 VL 2026.03		58.1
OpenAI o3 2026.03		57.1
Qwen3-VL-4B 2026.03		56.2
VideoDeepResearch 2026.03		55.5
AdaRETAKE 2026.03		53.3
GPT-4o 2026.03		48.9
Qwen2.5-VL-72B 2026.03		47.7
Qwen2.5-VL-72B 2026.03		47.3
PLM-8B 2026.03		44.5
Qwen3-VL-8B-Thinking + FrameRepeat 2026.03		44.3
InternVL2.5-78B 2026.03		43.6
InternVL3.5-8B 2026.03		43.4
STTS 2026.03		42.6
Qwen3-VL-8B-Thinking + CLIP-K 2026.03		42.3
Baseline 2026.03		42
Qwen3-VL-8B-Thinking + Random-K 2026.03		41.6
Qwen3-VL-8B-Thinking + Bottom-K 2026.03		41.2
ReAgent-V 2026.03		41.2
STTS 2026.03		41.1
Qwen3-VL-8B-Thinking 2026.03		40.6
STTS 2026.03		40.5
Qwen3-VL-8B-Thinking + FrameRepeat 2026.03		39.3
Qwen3-VL-8B-Thinking + CLIP-K 2026.03		38.4
Qwen2.5-VL-7B-Instruct + FrameRepeat 2026.03		38.2
Qwen3-VL-8B-Thinking + Random-K 2026.03		38.1
Qwen3-VL-8B-Thinking 2026.03		37.7
Qwen2.5-VL-7B-Instruct + CLIP-K 2026.03		37.5
Qwen3-VL-8B-Thinking + Bottom-K 2026.03		36.7
Qwen2.5-VL-7B-Instruct 2026.03		36
Qwen2.5-VL-7B-Instruct + Random-K 2026.03		36
Qwen2.5-VL-7B-Instruct + Bottom-K 2026.03		35.4
Qwen2.5-VL-7B-Instruct + FrameRepeat 2026.03		34.3
Qwen2.5-VL-7B-Instruct + CLIP-K 2026.03		33.8
Qwen2.5-VL-7B-Instruct + Random-K 2026.03		33.2
Gemini-1.5-Pro 2026.03		33.1
Qwen2.5-VL-7B-Instruct 2026.03		32.9
Qwen2.5-VL-7B-Instruct + Bottom-K 2026.03		32.3
VideoAgent 2026.03		29.3
VideoTree 2026.03		28.8