Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

mTOP

Benchmarks

Task NameDataset NameSOTA ResultTrend
ClassificationMTOP Domain (test)
Accuracy99.16
33
Short-text ClusteringMtop (test)
NMI79.11
20
Semantic ParsingmTOP (test)
Average Score91.8
17
Semantic ParsingMTOP
Accuracy50.43
14
ClusteringMTOP-I
Accuracy64
7
Intent ClusteringMTOP I
NMI0.7383
6
Next Slot PredictionMTOP NSP
MaxRatio1.26
4
Intent ClassificationMTOP
Max Ratio12.04
4
Next Sentence PredictionMTOP NSP
Macro Avg Performance61.16
3
Short-text ClusteringMtop
NMI-
0
Showing 10 of 10 rows