Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Semantic Parsing on Overnight Blk Few-shot 32 examples (test)
Loading...
74.4
Program Acc
Grammar Prompting
25.416
38.133
50.85
63.567
May 30, 2023
Program Acc
Execution Acc
Updated 4d ago
Evaluation Results
Method
Method
Links
Program Acc
Execution Acc
Grammar Prompting
Decoding=oracle gramma...
2023.05
74.4
96.5
Grammar Prompting
Decoding=oracle gramma...
2023.05
73.9
94.2
Grammar Prompting
Decoding=grammar and p...
2023.05
37.6
60.9
Grammar Prompting
Decoding=grammar const...
2023.05
37.1
60.4
Grammar Prompting
Decoding=unconstrained...
2023.05
34.8
57.4
Standard Prompting
Decoding=unconstrained...
2023.05
29.3
54.7
Standard Prompting
Decoding=constrained d...
2023.05
29.3
54.7
Linearized Derivation Tree Prompting
2023.05
27.3
56.4
Feedback
Search any
task
Search any
task