ATIS
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Sequence Classification | ATIS | Micro F197.92 | 64 | |
| Slot Filling | ATIS (test) | F1 Score96.89 | 55 | |
| Intent Detection | ATIS | ID Accuracy99.43 | 27 | |
| Unknown Intent Detection | ATIS (test) | Macro F186.79 | 20 | |
| Semantic Parsing | ATIS | Accuracy95.1 | 19 | |
| Named Entity Recognition | ATIS target | F1 Score95.5 | 18 | |
| Spoken Language Understanding | ATIS (test) | Slot F196.89 | 18 | |
| Spoken Language Understanding | ATIS | Slot F196.1 | 16 | |
| Slot Filling | ATIS | F1 Score98.46 | 14 | |
| Text-to-SQL | ATIS | Exact Match Accuracy47.8 | 13 | |
| Intent Detection | ATIS (test) | Intent Error1.57 | 13 | |
| Text-to-SQL | ATIS template (test) | Accuracy47.8 | 12 | |
| Natural Language Understanding | ATIS (test) | Intent Accuracy97.9 | 12 | |
| ASR Rescoring | ATIS (test) | WER6.39 | 11 | |
| Joint Slot Filling and Intent Detection | ATIS (test) | Slot F196 | 11 | |
| Language Modeling | ATIS (test) | PPL (LM)10.19 | 11 | |
| OOD Intent Detection | Persian-ATIS standard (test) | Macro F179.03 | 10 | |
| Semantic Parsing | ATIS (dev) | Query Acc40.2 | 10 | |
| Automatic Speech Recognition | ATIS (test) | WER1.1 | 9 | |
| Generative Error Correction | ATIS | WER1.45 | 9 | |
| Intent Detection | ATIS | F1 Score97.8 | 8 | |
| ASR Error Correction | ATIS (test) | WER1.1 | 8 | |
| Semantic Parsing | ATIS (test) | Accuracy91.3 | 8 | |
| Automatic Speech Recognition | ATIS airline info | WER2 | 7 | |
| Semantic Parsing | ATIS length split | Accuracy41.39 | 7 |
Showing 25 of 42 rows