CLINC150
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Short-text Clustering | Clinc150 (test) | NMI95.72 | 23 | |
| Intent Classification | CLINC150 DialoGLUE 10-shot | Accuracy95.58 | 9 | |
| Intent Classification | CLINC150 | Accuracy98.45 | 9 | |
| Intent Classification | Clinc150 5-shot (test) | Accuracy89.69 | 8 | |
| Out-of-Domain Detection | CLINC150 75% known ratio (test) | Accuracy0.877 | 6 | |
| Out-of-Domain Detection | CLINC150 50% known ratio (test) | Accuracy88.61 | 6 | |
| Out-of-Domain Detection | CLINC150 25% known ratio (test) | Accuracy89.79 | 6 | |
| Unknown Intent Detection | CLINC150 75% seen classes (test) | Accuracy88.08 | 6 | |
| Unknown Intent Detection | CLINC150 50% seen classes (test) | Accuracy88.33 | 6 | |
| Unknown Intent Detection | CLINC150 25% seen classes (test) | Accuracy88.44 | 6 | |
| Calibration | Clinc150 | ECE0.236 | 4 |
Showing 11 of 11 rows