Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Video Question Answering on INST-IT Bench Video
Loading...
81
MC Q&A Accuracy
GPT-4o
13.504
31.027
48.55
66.073
Dec 4, 2024
MC Q&A Accuracy
OE Q&A Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
MC Q&A Accuracy
OE Q&A Accuracy
GPT-4o
#IT=N/A
2024.12
81
65.5
Gemini-1.5-flash
#IT=N/A
2024.12
75.8
57.9
Qwen2-VL-Instruct
LLM=Qwen2-72B, #IT=N/A
2024.12
74.6
45.5
LLaVA-NeXT-INST-IT
LLM=Qwen2-7B, #IT=920K
2024.12
53.3
45.7
LLaVA-Video
LLM=Qwen2-7B, #IT=~7.4M
2024.12
53.2
34.1
LLaVA-OV
LLM=Qwen2-7B, #IT=~8.8M
2024.12
45.6
33.2
InternVL2
LLM=InternLM2.5-7B, #I...
2024.12
45.5
39.8
LLaVA-NeXT-INST-IT
LLM=Vicuna-7B, #IT=920K
2024.12
42.1
49.3
LLaVA-OV (SI)
LLM=Qwen2-7B, #IT=~7.2M
2024.12
36.4
31.4
Random Guess
#IT=N/A
2024.12
25
-
LLaVA-NeXT-Video
LLM=Vicuna-7B, #IT=860K
2024.12
24.8
25.8
ShareGPT4Video
LLM=Llama3-8B, #IT=~1.0M
2024.12
16.1
27.8
Feedback
Search any
task
Search any
task