CFQ
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Semantic Parsing | CFQ MCD3 | Accuracy95.5 | 33 | |
| Semantic Parsing | CFQ (MCD2) | Accuracy95.3 | 33 | |
| Semantic Parsing | CFQ (MCD1) | Accuracy98.6 | 33 | |
| Semantic Parsing | CFQ MCD avg | Exact Match Accuracy95 | 22 | |
| Semantic Parsing | CFQ MCD3 (test) | Accuracy77.9 | 15 | |
| Semantic Parsing | CFQ MCD2 (test) | Accuracy0.853 | 15 | |
| Semantic Parsing | CFQ MCD1 (test) | Accuracy88.7 | 15 | |
| Semantic Parsing | CFQ MCD1, MCD2, MCD3 | MCD1 Accuracy94.3 | 9 | |
| Semantic Parsing | CFQ Maximum Compound Divergence (MCD) | MCD178.3 | 4 | |
| Knowledge Base Question Answering | CFQ (MCD1, MCD2, MCD3) | MCD1 Accuracy87.8 | 2 | |
| Dependency parsing | CFQ 1.0 (MCD3) | Metric- | 0 | |
| Dependency parsing | CFQ 1.0 (MCD2) | Metric- | 0 | |
| Dependency parsing | CFQ 1.0 (MCD1) | Metric- | 0 |
Showing 13 of 13 rows