Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

WikiSQL

Benchmarks

Task NameDataset NameSOTA ResultTrend
Table Question AnsweringWikiSQL (test)
Accuracy95.1
55
Semantic ParsingWikiSQL (test)
Execution Accuracy82.6
27
Table Question AnsweringWIKISQL WEAK (test)
Denotation Accuracy90.4
20
Table Question AnsweringWIKISQL WEAK (dev)
Denotation Accuracy91.1
19
Natural Language to SQLWikiSQL (test)
Accuracy88.7
17
Table Question AnsweringWikiSQL
Accuracy92.07
16
SQL Query GenerationWikiSQL (dev)
Accuracy89.5
13
Semantic ParsingWikiSQL (dev)
Accuracy84
13
Text-to-SQLWikiSQL Fully-supervised (test)
Execution Accuracy90.8
12
Text-to-SQLWikiSQL Fully-supervised (dev)
Execution Accuracy91.4
12
Text-to-SQLWikiSQL 4 (test)
Execution Accuracy74.6
11
Text-to-SQLWikiSQL 4 (dev)
Execution Accuracy75.1
11
Text-to-SQLWikiSQL ADVETA-ADD
Exact Match (EM)79.9
9
Text-to-SQLWikiSQL ADVETA-RPL
Exact Match (EM)69.2
9
Text-to-SQLWikiSQL original (dev)
Exact Match (EM)84.3
9
Text-to-SQLWikiSQL Weakly-supervised (test)
Accuracy84.7
9
Text-to-SQLWikiSQL Weakly-supervised (dev)
Accuracy85.9
9
Text-to-SQLWikiSQL (val)
Accuracy74
8
Text-to-SQLWikiSQL (test)
Logic Form Accuracy84.5
8
Text-to-SQLWikiSQL (dev)
Logic Form Acc85.4
8
Text-to-SQLWikiSQL 1.0 (test)
Execution Accuracy82.6
8
Text-to-SQLWikiSQL 1.0 (dev)
Execution Accuracy0.855
8
Subtable SelectionWikiSQL
Precision89.27
7
Table ParsingWikiSQL v1.0 (test)
Denotation Accuracy86.4
6
SQL-to-text generationWikiSQL
BLEU-438.97
6
Showing 25 of 30 rows