Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Binary Predicate Prediction on WebLI Qualitative Spatial VQA human-annotated (test)
Loading...
75.2
Accuracy
SpatialVLM
49.2
55.95
62.7
69.45
Jan 22, 2024
Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
SpatialVLM
2024.01
75.2
LLaVA-1.5
2024.01
71.3
GPT-4V
2024.01
68
PaLI
variant=PaLI-X 55B
2024.01
60.7
InstructBLIP
2024.01
60.4
PaLM 2-E
parameter count=PaLM 2...
2024.01
50.4
PaLM-E
variant=PaLM-E 12B
2024.01
50.2
Feedback
Search any
task
Search any
task