WikiSQL
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Table Question Answering | WikiSQL | Accuracy92.07 | 55 | |
| Table Question Answering | WikiSQL (test) | Accuracy95.1 | 55 | |
| Dataset-level accuracy estimation | WikiSQL to Spider | MAE3.2 | 54 | |
| Semantic Parsing | WikiSQL (test) | Execution Accuracy82.6 | 27 | |
| Table Question Answering | WIKISQL WEAK (test) | Denotation Accuracy90.4 | 20 | |
| Table Question Answering | WIKISQL WEAK (dev) | Denotation Accuracy91.1 | 19 | |
| NL-to-SQL | WikiSQL | Execution Accuracy87.4 | 18 | |
| Complex Reasoning on Structured Data | WikiSQL-E | DA85.6 | 17 | |
| Natural Language to SQL | WikiSQL (test) | Accuracy88.7 | 17 | |
| SQL Query Generation | WikiSQL (dev) | Accuracy89.5 | 13 | |
| Semantic Parsing | WikiSQL (dev) | Accuracy84 | 13 | |
| Lossless Compression | WikiSQL (test) | Bits/Byte0.629 | 12 | |
| Text-to-SQL | WikiSQL Fully-supervised (test) | Execution Accuracy90.8 | 12 | |
| Text-to-SQL | WikiSQL Fully-supervised (dev) | Execution Accuracy91.4 | 12 | |
| Text-to-SQL | WikiSQL 4 (test) | Execution Accuracy74.6 | 11 | |
| Text-to-SQL | WikiSQL 4 (dev) | Execution Accuracy75.1 | 11 | |
| SQL Agent | WikiSQL | Accuracy60.8 | 10 | |
| Text-to-SQL | WikiSQL ADVETA-ADD | Exact Match (EM)79.9 | 9 | |
| Text-to-SQL | WikiSQL ADVETA-RPL | Exact Match (EM)69.2 | 9 | |
| Text-to-SQL | WikiSQL original (dev) | Exact Match (EM)84.3 | 9 | |
| Text-to-SQL | WikiSQL Weakly-supervised (test) | Accuracy84.7 | 9 | |
| Text-to-SQL | WikiSQL Weakly-supervised (dev) | Accuracy85.9 | 9 | |
| Table Retrieval | WikiSQL | Recall@1 (Base)52 | 8 | |
| Text-to-SQL | WikiSQL (val) | Accuracy74 | 8 | |
| Text-to-SQL | WikiSQL (test) | Logic Form Accuracy84.5 | 8 |
Showing 25 of 37 rows