Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Semantic Parsing on SMCalFlow CS (8-C)
Loading...
77.3
Exact Match Accuracy
Cover-LS (Oracle)
-2.78
18.01
38.8
59.59
Dec 13, 2022
Exact Match Accuracy
Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Exact Match Accuracy
Accuracy
Cover-LS (Oracle)
Model=Codex, Oracle St...
2022.12
77.3
-
Cover-LS
Model=Codex
2022.12
53.3
-
Cover-Utt
Model=Codex
2022.12
51
-
DPP
Model=Codex
2022.12
44
-
T5 (fine tuned w/o prompts)
Model=T5-large
2022.12
34.5
-
Top-K
Model=Codex
2022.12
34
-
Top-K (Oracle)
Model=Codex, Oracle St...
2022.12
33
-
Random
Model=Codex
2022.12
0.3
-
T5
2022.12
-
34.7
T5+CSL
CSL=true
2022.12
-
51.6
BART
model_size=large
2022.12
-
32.1
BART + R-Dangleshr
interval=6, backbone=B...
2022.12
-
36.3
Feedback
Search any
task
Search any
task