Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Spatial Visual Question Answering on Human-annotated quantitative spatial relationship dataset (test)
Loading...
99
Output Accuracy (%)
SpatialVLM
-2.92
23.54
50
76.46
Jan 22, 2024
Output Accuracy (%)
Range Compliance Rate [50-200]%
Updated 1mo ago
Evaluation Results
Method
Method
Links
Output Accuracy (%)
Range Compliance Rate [50-200]%
SpatialVLM
2024.01
99
37.2
PaLM 2-E
2024.01
88.8
33.9
PaLM-E
2024.01
83.2
23.7
PaLI
2024.01
52
5.3
InstructBLIP
2024.01
26
7.9
LLaVA-1.5
2024.01
20.9
13
GPT-4V
2024.01
1
0
Feedback
Search any
task
Search any
task