Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Semantic Parsing on Spider (dev)
Loading...
75.5
Exact Match Accuracy
PICARD
-3.02
17.365
37.75
58.135
Jan 16, 2022
Exact Match Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Exact Match Accuracy
PICARD
Extra Pre-training=false
2022.01
75.5
SmBop
Extra Pre-training=true
2022.01
74.7
T5-3B
Mode=finetune
2022.01
71.76
T5-3B
Backbone=T5-3B, Extra...
2022.01
71.76
T5-large
Backbone=T5-large, Ext...
2022.01
66.63
T5-base
Backbone=T5-base, Extr...
2022.01
58.12
Codex 175B
Few-shot selection str...
2022.01
43.23
Codex 175B
Few-shot selection str...
2022.01
40.72
GPT-3 175B
Few-shot selection str...
2022.01
20
GPT-3 175B
Few-shot selection str...
2022.01
18.33
T0 3B
Mode=zero-shot
2022.01
0
Feedback
Search any
task
Search any
task