Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Semantic Parsing on GeoQuery (Templ.)
Loading...
85.9
Exact Match Accuracy
T5 (fine tuned w/o prompts)
48.252
58.026
67.8
77.574
Dec 13, 2022
Exact Match Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Exact Match Accuracy
T5 (fine tuned w/o prompts)
Model=T5-large, Evalua...
2022.12
85.9
Cover-LS
Model=Codex, Evaluatio...
2022.12
85.3
Cover-Utt
Model=Codex, Evaluatio...
2022.12
82.1
DPP
Model=Codex, Evaluatio...
2022.12
81.2
Cover-LS (Oracle)
Model=Codex, Evaluatio...
2022.12
81.2
Top-K
Model=Codex, Evaluatio...
2022.12
78
Top-K (Oracle)
Model=Codex, Evaluatio...
2022.12
74.5
Random
Model=Codex, Evaluatio...
2022.12
49.7
Feedback
Search any
task
Search any
task