Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Semantic Parsing on GeoQuery (Len.)
Loading...
74.3
Exact Match Accuracy
DPP
28.956
40.728
52.5
64.272
Dec 13, 2022
Exact Match Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Exact Match Accuracy
DPP
Model=Codex
2022.12
74.3
Cover-LS (Oracle)
Model=Codex, Oracle St...
2022.12
74
Cover-Utt
Model=Codex
2022.12
73.7
Cover-LS
Model=Codex
2022.12
72.7
Cover-LS (NoFT)
2022.12
70
T5 Base + CSL-Aug (FT)
Source=Qiu et al. 2022a
2022.12
67.8
Top-K (NoFT)
2022.12
65.8
Top-K
Model=Codex
2022.12
64.3
PaLM 540B (ICL)
Source=Qiu et al. 2022b
2022.12
57.9
Top-K (Oracle)
Model=Codex, Oracle St...
2022.12
55.7
PaLM 62B (FT)
Source=Qiu et al. 2022b
2022.12
44.2
T5 Base (FT)
Source=Qiu et al. 2022a
2022.12
41.8
T5 11B (Prompt Tuning)
Source=Qiu et al. 2022b
2022.12
41.5
T5 Base (FT)
Source=Qiu et al. 2022b
2022.12
40
T5 Large (fine tuned w/o prompts)
2022.12
37.2
T5 (fine tuned w/o prompts)
Model=T5-large
2022.12
36
Random
Model=Codex
2022.12
30.7
Feedback
Search any
task
Search any
task