Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

WikiSQL

Benchmarks

Task NameDataset NameSOTA ResultTrend
Table Question AnsweringWikiSQL (test)
Accuracy95.1
55
Dataset-level accuracy estimationWikiSQL to Spider
MAE3.2
54
Semantic ParsingWikiSQL (test)
Execution Accuracy82.6
27
Table Question AnsweringWIKISQL WEAK (test)
Denotation Accuracy90.4
20
Table Question AnsweringWIKISQL WEAK (dev)
Denotation Accuracy91.1
19
NL-to-SQLWikiSQL
Execution Accuracy87.4
18
Natural Language to SQLWikiSQL (test)
Accuracy88.7
17
Table Question AnsweringWikiSQL
Accuracy92.07
16
SQL Query GenerationWikiSQL (dev)
Accuracy89.5
13
Semantic ParsingWikiSQL (dev)
Accuracy84
13
Lossless CompressionWikiSQL (test)
Bits/Byte0.629
12
Text-to-SQLWikiSQL Fully-supervised (test)
Execution Accuracy90.8
12
Text-to-SQLWikiSQL Fully-supervised (dev)
Execution Accuracy91.4
12
Text-to-SQLWikiSQL 4 (test)
Execution Accuracy74.6
11
Text-to-SQLWikiSQL 4 (dev)
Execution Accuracy75.1
11
Text-to-SQLWikiSQL ADVETA-ADD
Exact Match (EM)79.9
9
Text-to-SQLWikiSQL ADVETA-RPL
Exact Match (EM)69.2
9
Text-to-SQLWikiSQL original (dev)
Exact Match (EM)84.3
9
Text-to-SQLWikiSQL Weakly-supervised (test)
Accuracy84.7
9
Text-to-SQLWikiSQL Weakly-supervised (dev)
Accuracy85.9
9
Text-to-SQLWikiSQL (val)
Accuracy74
8
Text-to-SQLWikiSQL (test)
Logic Form Accuracy84.5
8
Text-to-SQLWikiSQL (dev)
Logic Form Acc85.4
8
Text-to-SQLWikiSQL 1.0 (test)
Execution Accuracy82.6
8
Text-to-SQLWikiSQL 1.0 (dev)
Execution Accuracy0.855
8
Showing 25 of 34 rows