GEOQUERY
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Semantic Parsing | GeoQuery (i.i.d.) | Exact Match Accuracy93.6 | 32 | |
| Semantic Parsing | GeoQuery compositional | Accuracy89.5 | 29 | |
| Semantic Parsing | GeoQuery (Len.) | Exact Match Accuracy74.3 | 17 | |
| Text-to-SQL | Geoquery | Exact Match Accuracy83 | 17 | |
| Reasoning | GeoQuery | Accuracy84.64 | 14 | |
| Semantic Parsing | Geoquery (test) | Accuracy91.1 | 14 | |
| Semantic Parsing | GeoQuery (TMCD) | Exact Match Acc82.8 | 12 | |
| Text-to-SQL | GEOQUERY template (test) | Accuracy0.83 | 12 | |
| Semantic Parsing | GeoQuery Few-shot 32 examples (test) | Program Accuracy95.7 | 8 | |
| Semantic Parsing | GeoQuery (Templ.) | Exact Match Accuracy85.9 | 8 | |
| Semantic Parsing | GEOQUERY 280-sentence Geo880 (test) | Precision96.3 | 7 | |
| Semantic Parsing | GeoQuery Length split | Execution Accuracy95.7 | 6 | |
| Semantic Parsing | GeoQuery (Template) | Accuracy79 | 4 | |
| Semantic Parsing | GeoQuery | Execution Accuracy98.6 | 4 | |
| Semantic Parsing | GeoQuery NewFunc | Exec Acc0.962 | 3 | |
| Semantic Parsing | GeoQuery Template split | Execution Accuracy97.9 | 3 |
Showing 16 of 16 rows