Long-video understanding on Video-Holmes (test)

43.4Video-Holmes Score

Qwen3-VL-8B-Thinking + FrameRepeat

Updated 1mo ago

Evaluation Results

Method	Links
Qwen3-VL-8B-Thinking + FrameRepeat 2026.03		43.4
Qwen3-VL-8B-Thinking + CLIP-K 2026.03		41.5
Qwen3-VL-8B-Thinking 2026.03		41
Qwen3-VL-8B-Thinking + Bottom-K 2026.03		41
Qwen3-VL-8B-Thinking + FrameRepeat 2026.03		40.5
Qwen3-VL-8B-Thinking + CLIP-K 2026.03		40.2
Qwen3-VL-8B-Thinking + Random-K 2026.03		40.2
Qwen3-VL-8B-Thinking 2026.03		40
Qwen3-VL-8B-Thinking + Bottom-K 2026.03		39.3
Qwen3-VL-8B-Thinking + Random-K 2026.03		39.3
Qwen2.5-VL-7B-Instruct + FrameRepeat 2026.03		36
Qwen2.5-VL-7B-Instruct + CLIP-K 2026.03		35.1
Qwen2.5-VL-7B-Instruct + Bottom-K 2026.03		35.1
Qwen2.5-VL-7B-Instruct 2026.03		35
Qwen2.5-VL-7B-Instruct + Random-K 2026.03		35
Qwen2.5-VL-7B-Instruct + FrameRepeat 2026.03		34.9
Qwen2.5-VL-7B-Instruct + Random-K 2026.03		33.7
Qwen2.5-VL-7B-Instruct 2026.03		33.4
Qwen2.5-VL-7B-Instruct + Bottom-K 2026.03		33.4
Qwen2.5-VL-7B-Instruct + CLIP-K 2026.03		33