Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Geospatial Question Answering on MapQA
Loading...
62.45
Overall Score
Spatial-Agent
11.594
24.797
38
51.203
Jan 23, 2026
Overall Score
Adj Matches
Amenity Matches
Amenity-Attribute Matches
Amenity-Attribute Specific Matches
Cmp-Cl Score
Distance Error
Updated 3mo ago
Evaluation Results
Method
Method
Links
Overall Score
Adj Matches
Amenity Matches
Amenity-Attribute Matches
Amenity-Attribute Specific Matches
Cmp-Cl Score
Distance Error
Spatial-Agent
Type=Open-Source, Back...
2026.01
62.45
54
84
58
76
64.71
38
Spatial-Agent
Type=Closed-Source, Ba...
2026.01
61.45
52
82
56
74
64.71
40
Spatial-Agent
Type=Open-Source, Back...
2026.01
61.45
48
76
64
78
64.71
38
Reflexion
Type=Closed-Source, Ba...
2026.01
53.79
50
80
30
64
64.71
34
ReAct
Type=Closed-Source, Ba...
2026.01
43.79
56
28
16
64
64.71
34
Direct LLM
Type=Closed-Source, Ba...
2026.01
13.55
6
36
4
0
35.29
0
Feedback
Search any
task
Search any
task