Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Spatial Understanding on SEED-Bench Spatial
Loading...
66.28
Accuracy
CVLM
46.6448
51.7424
56.84
61.9376
Feb 21, 2024
Accuracy
Updated 3d ago
Evaluation Results
Method
Method
Links
Accuracy
CVLM
LLM=Qwen-VL
2024.02
66.28
CVLM (3M IKPairs, Objects=3)
LLM=Vicuna-7B, Objects=3
2024.02
62.93
Qwen-VL
LLM=Qwen
2024.02
62.41
CVLM (3M IKPairs, Objects=5)
LLM=Vicuna-7B, Objects=5
2024.02
60.3
InstructBLIP
LLM=Flan-T5-XXL
2024.02
60.29
CVLM (3M IKPairs, Objects=8)
LLM=Vicuna-7B, Objects=8
2024.02
59.83
CVLM (3M IKPairs) w/o FKA
LLM=Vicuna-7B
2024.02
59.73
CVLM (3M IKPairs, Objects=1)
LLM=Vicuna-7B, Objects=1
2024.02
59.65
CVLM w/o FKA
LLM=Vicuna-7B
2024.02
59.63
InstructBLIP
LLM=Vicuna-7B
2024.02
58.8
CVLM
LLM=Vicuna-7B
2024.02
58.77
InstructBLIP
LLM=Flan-T5-XL
2024.02
57.8
CVLM w/o (FKA & VKA)
LLM=Vicuna-7B
2024.02
55.11
LLaVA-v1.5†
LLM=Vicuna-7B
2024.02
55.05
MiniGPT4
LLM=Vicuna-7B
2024.02
47.4
Feedback
Search any
task
Search any
task