Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Visual Question Answering on A-OKVQA Open-Ended
Loading...
72.14
Accuracy
CVLM
52.9728
57.9489
62.925
67.9011
Feb 21, 2024
Accuracy
Updated 3d ago
Evaluation Results
Method
Method
Links
Accuracy
CVLM
LLM=Qwen-VL
2024.02
72.14
CVLM (3M IKPairs, Objects=3)
LLM=Vicuna-7B, Objects=3
2024.02
70.91
CVLM (3M IKPairs, Objects=1)
LLM=Vicuna-7B, Objects=1
2024.02
70.48
CVLM (3M IKPairs, Objects=5)
LLM=Vicuna-7B, Objects=5
2024.02
70.39
CVLM (3M IKPairs) w/o FKA
LLM=Vicuna-7B
2024.02
70.22
CVLM (3M IKPairs, Objects=8)
LLM=Vicuna-7B, Objects=8
2024.02
69.08
InstructBLIP
LLM=Vicuna-7B
2024.02
67.86
Qwen-VL
LLM=Qwen
2024.02
67.25
CVLM
LLM=Vicuna-7B
2024.02
66.99
CVLM w/o FKA
LLM=Vicuna-7B
2024.02
65.59
LLaVA-v1.5†
LLM=Vicuna-7B
2024.02
65.27
CVLM w/o (FKA & VKA)
LLM=Vicuna-7B
2024.02
64.37
InstructBLIP
LLM=Flan-T5-XXL
2024.02
62.01
InstructBLIP
LLM=Flan-T5-XL
2024.02
61.05
BLIP2
LLM=Flan-T5-XXL
2024.02
53.71
Feedback
Search any
task
Search any
task