Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Semantic Parsing on SMCalFlow CS (i.i.d.)
Loading...
88.5
Exact Match Accuracy
T5 (fine tuned w/o prompts)
41.18
53.465
65.75
78.035
Dec 13, 2022
Exact Match Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Exact Match Accuracy
T5 (fine tuned w/o prompts)
Model=T5-large
2022.12
88.5
Cover-LS
Model=Codex
2022.12
86
Top-K (Oracle)
Model=Codex, Oracle St...
2022.12
85
Cover-LS (Oracle)
Model=Codex, Oracle St...
2022.12
84.3
Cover-Utt
Model=Codex
2022.12
83.3
Top-K
Model=Codex
2022.12
81.7
DPP
Model=Codex
2022.12
79.3
Random
Model=Codex
2022.12
43
Feedback
Search any
task
Search any
task