Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Semantic Parsing on SMCalFlow Few-shot 16 examples (test)
Loading...
83.6
Program Accuracy
Grammar Prompting
44.912
54.956
65
75.044
May 30, 2023
Program Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Program Accuracy
Grammar Prompting
Decoding=oracle gramma...
2023.05
83.6
Grammar Prompting
Decoding=oracle gramma...
2023.05
80
Grammar Prompting
Decoding=grammar and p...
2023.05
52.4
Grammar Prompting
Decoding=grammar const...
2023.05
51.3
Grammar Prompting
Decoding=unconstrained...
2023.05
50.8
Linearized Derivation Tree Prompting
2023.05
50
Standard Prompting
Decoding=constrained d...
2023.05
49.2
Standard Prompting
Decoding=unconstrained...
2023.05
46.4
Feedback
Search any
task
Search any
task