Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Spatial relationship understanding on EmbSpatial
Loading...
62.09
Accuracy
Gemma3-27B-IT
18.878
30.0965
41.315
52.5335
Jun 15, 2026
Accuracy
PASS@4
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
PASS@4
Gemma3-27B-IT
Model scale=27B
2026.06
62.09
72.12
Thinking with Grounding Point
Model scale=4B, Ground...
2026.06
60.88
83.1
Thinking with Grounding Point
Model scale=4B, Ground...
2026.06
60.25
83.21
Thinking with Grounding Box
Model scale=4B, Ground...
2026.06
59.93
82.66
Thinking with Grounding Box
Model scale=4B, Ground...
2026.06
57.62
81.46
Gemma3-12B-IT
Model scale=12B
2026.06
56.68
65.14
Gemma3-4B-IT
Model scale=4B
2026.06
49.13
63.79
Non-grounded Thinking
Model scale=4B, Ground...
2026.06
20.54
42.53
Feedback
Search any
task
Search any
task