SParC
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Dataset-level accuracy estimation | SParC to CoSQL | MAE1.5 | 54 | |
| Context-dependent Text-to-SQL | SParC 1.0 (dev) | Question Match67.7 | 27 | |
| Context-dependent Text-to-SQL | SParC (test) | Question Match65.7 | 12 | |
| Context-dependent Text-to-SQL | SParC 1.0 (test) | Question Match67.7 | 12 | |
| Multi-turn Text-to-SQL | SparC (dev) | QM EM67.7 | 11 | |
| Conversational text-to-SQL | SParC (dev) | Question Match64.1 | 7 | |
| Semantic Parsing | SParC (dev) | Query Accuracy42.4 | 6 | |
| Language-to-SQL Parsing | Sparc (test) | Exact Match (EM)47.9 | 3 | |
| Language-to-SQL Parsing | Sparc (dev) | EM48.9 | 3 | |
| Multi-turn Text-to-SQL | SParC (ADVETA-ADD) | EM42.9 | 2 | |
| Multi-turn Text-to-SQL | SParC (ADVETA-RPL) | Exact Match (EM)34.2 | 2 | |
| Multi-turn Text-to-SQL | SParC original (dev) | Exact Match (EM)50.7 | 2 |
Showing 12 of 12 rows