SMCalFlow
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Semantic Parsing | SMCalFlow | Program Accuracy88.9 | 22 | |
| Semantic Parsing | SMCalFlow-CS (16-C) | Accuracy73.5 | 20 | |
| Task-oriented dialogue | SMCalFlow (test) | SacreBLEU64.29 | 9 | |
| Semantic Parsing | SMCalFlow Few-shot 16 examples (test) | Program Accuracy83.6 | 8 | |
| Semantic Parsing | SMCalFlow-CS (0-C) | Exact Match Acc40.7 | 8 | |
| Semantic Parsing | SMCalFlow CS (i.i.d.) | Exact Match Accuracy88.5 | 8 | |
| Semantic Parsing | SMCalFlow-CS (32-C) | Accuracy70.4 | 8 | |
| Semantic Parsing | SMCalFlow CS (8-C) | Exact Match Accuracy77.3 | 8 | |
| Dialogue Response Generation | SMCalFlow2Text v2.0 (val) | BLEU100 | 4 |
Showing 9 of 9 rows