Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Spatial relationship understanding on VSR zeroshot
Loading...
69.25
Accuracy
Gemma3-27B-IT
51.1436
55.8443
60.545
65.2457
Jun 15, 2026
Accuracy
PASS@4
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
PASS@4
Gemma3-27B-IT
Model scale=27B
2026.06
69.25
70.7
Thinking with Grounding Box
Model scale=4B, Ground...
2026.06
68.08
86.91
Gemma3-12B-IT
Model scale=12B
2026.06
67.98
69.56
Thinking with Grounding Box
Model scale=4B, Ground...
2026.06
66.82
87.64
Thinking with Grounding Point
Model scale=4B, Ground...
2026.06
65.38
83.88
Thinking with Grounding Point
Model scale=4B, Ground...
2026.06
64.67
81.42
Gemma3-4B-IT
Model scale=4B
2026.06
56.65
57.94
Non-grounded Thinking
Model scale=4B, Ground...
2026.06
51.84
79.13
Feedback
Search any
task
Search any
task