Banking
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| New Intent Discovery | BANKING | NMI90.51 | 76 | |
| Information Retrieval | BANKING77 | MAP71 | 40 | |
| Generalized Category Discovery | BANKING (test) | Accuracy80.26 | 28 | |
| Intent Detection | BANKING 10-shot (test) | Accuracy89.79 | 16 | |
| Intent Clustering | BANKING 2020 (full) | NMI79.56 | 13 | |
| Intent Detection | BANKING 5-shot (test) | Accuracy84.01 | 12 | |
| Intent Classification | Banking (BANK) (test) | Accuracy93.31 | 11 | |
| Intent Detection | BANKING Full (test) | Accuracy94.42 | 11 | |
| Dialogue Evaluation | Banking (test) | G-E6.72 | 10 | |
| Intent Classification | Banking (BANK) (train) | Accuracy72.94 | 10 | |
| Open Intent Classification | BANKING 50% known classes (test) | Accuracy86.54 | 10 | |
| Text Classification | Banking | Total Communication Time (10^3 s)1.86 | 9 | |
| Intent Clustering | BANKING 1.0 (test) | K (Pred)110 | 9 | |
| Text Classification | Banking77 | Accuracy91.2 | 8 | |
| Open intent recognition | BANKING | Accuracy89.08 | 6 | |
| Unknown Intent Detection | Banking 75% seen classes (test) | Accuracy81.07 | 6 | |
| Unknown Intent Detection | Banking 50% seen classes (test) | Accuracy72.69 | 6 | |
| Unknown Intent Detection | Banking 25% seen classes (test) | Accuracy74.11 | 6 | |
| Intent Classification | Banking77 (full) | F1-Macro92 | 5 | |
| Intent Classification | Banking77 (adversarial) | Accuracy84.97 | 5 | |
| Open Intent Classification | BANKING 75% known classes (test) | Accuracy81.08 | 5 | |
| Open Intent Classification | BANKING 25% known classes (test) | Accuracy78.85 | 5 | |
| Theme Label Quality | Banking | ROUGE-135.3 | 4 | |
| Theme Distribution | Banking | Acc0.567 | 4 | |
| Intent Classification | Banking (test) | Accuracy93.2 | 3 |
Showing 25 of 25 rows