Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Banking

Benchmarks

Task NameDataset NameSOTA ResultTrend
New Intent DiscoveryBANKING
NMI90.51
56
Intent DetectionBANKING 10-shot (test)
Accuracy89.79
16
Intent ClusteringBANKING 2020 (full)
NMI79.56
13
Intent DetectionBANKING 5-shot (test)
Accuracy84.01
12
Intent ClassificationBanking (BANK) (test)
Accuracy93.31
11
Intent DetectionBANKING Full (test)
Accuracy94.42
11
Intent ClassificationBanking (BANK) (train)
Accuracy72.94
10
Open Intent ClassificationBANKING 50% known classes (test)
Accuracy86.54
10
Text ClassificationBanking
Total Communication Time (10^3 s)1.86
9
Intent ClusteringBANKING 1.0 (test)
K (Pred)110
9
Open intent recognitionBANKING
Accuracy89.08
6
Unknown Intent DetectionBanking 75% seen classes (test)
Accuracy81.07
6
Unknown Intent DetectionBanking 50% seen classes (test)
Accuracy72.69
6
Unknown Intent DetectionBanking 25% seen classes (test)
Accuracy74.11
6
Intent ClassificationBanking77 (adversarial)
Accuracy84.97
5
Open Intent ClassificationBANKING 75% known classes (test)
Accuracy81.08
5
Open Intent ClassificationBANKING 25% known classes (test)
Accuracy78.85
5
Theme Label QualityBanking
ROUGE-135.3
4
Theme DistributionBanking
Acc0.567
4
Intent ClassificationBanking (test)
Accuracy93.2
3
Showing 20 of 20 rows