Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Semantic Parsing on GeoQuery Few-shot 32 examples (test)
Loading...
95.7
Program Accuracy
Grammar Prompting
57.116
67.133
77.15
87.167
May 30, 2023
Program Accuracy
Execution Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Program Accuracy
Execution Accuracy
Grammar Prompting
Decoding=oracle gramma...
2023.05
95.7
96.1
Grammar Prompting
Decoding=oracle gramma...
2023.05
95.7
96.8
Grammar Prompting
Decoding=grammar and p...
2023.05
69.6
88.9
Grammar Prompting
Decoding=grammar const...
2023.05
67.9
88.6
Grammar Prompting
Decoding=unconstrained...
2023.05
67.1
87.5
Standard Prompting
Decoding=constrained d...
2023.05
61.1
81.8
Standard Prompting
Decoding=unconstrained...
2023.05
60.7
81.5
Linearized Derivation Tree Prompting
2023.05
58.6
77.5
Feedback
Search any
task
Search any
task