Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Intent Semantic Toolkit

Benchmarks

Task NameDataset NameSOTA ResultTrend
Triplet Evaluation (Ori-Imp)Intent Semantic Toolkit (test)
Teasy Score71
7
Multi-class ClassificationIntent Semantic Toolkit (test)
Accuracy (0-shot)33.9
6
ClusteringIntent Semantic Toolkit (test)
KM Score65.9
6
Binary ClassificationIntent Semantic Toolkit (test)
Ori Score94.1
6
Multi-class Intent ClassificationIntent Semantic Toolkit
Accuracy (0-shot)28.8
4
Intent ClusteringIntent Semantic Toolkit
Agg Score61.4
4
Binary Intent ClassificationIntent Semantic Toolkit
Ori Accuracy89.6
4
Triplet TaskIntent Semantic Toolkit Ori-Ori
Thard24
4
Triplet Evaluation (Ori-Ori)Intent Semantic Toolkit (test)
Teasy51.1
3
Showing 9 of 9 rows