Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

CMU-MOSEI

Benchmarks

Task NameDataset NameSOTA ResultTrend
Multimodal Sentiment AnalysisCMU-MOSEI (test)
F1 Score91.7
401
Sentiment AnalysisCMU-MOSEI (test)
F1 Score87.26
96
Multimodal Sentiment AnalysisCMU-MOSEI standard (test)
Accuracy85.86
65
Sentiment AnalysisCMU-MOSEI
WF10.7766
60
Multimodal Emotion RecognitionCMU-MOSEI (test)
ACC754.5
56
Multimodal Sentiment AnalysisCMU-MOSEI
A2 Score87.3
27
Multimodal Sentiment AnalysisCMU-MOSEI (0.3, 0.5, 0.7) (test)
Accuracy84.76
24
Multimodal Sentiment AnalysisCMU-MOSEI segments (test)
ACC286.4
22
Multimodal Sentiment AnalysisCMU-MOSEI Word Aligned (test)
Accuracy (7-Class)51.8
22
Emotion RecognitionCMU-MOSEI
F1 Score84
19
Emotion RecognitionCMU-MOSEI (test)
Accuracy (7)54.6
19
Multimodal Sentiment AnalysisCMU-MOSEI Unaligned (test)
Accuracy (2-Class)82.4
18
Multimodal Sentiment AnalysisCMU-MOSEI BERT-based (test)
Accuracy (2-Class)85.7
14
Multimodal ClassificationCMU-MOSEI β = 30% (test)
Overall Accuracy38.57
13
Multimodal ClassificationCMU-MOSEI β = 10% (test)
Overall Accuracy36.13
13
Multimodal Sentiment AnalysisCMU-MOSEI (0.7, 0.5, 0.3) (test)
Accuracy82.53
12
Multimodal Sentiment AnalysisCMU-MOSEI (0.7, 0.3, 0.5) (test)
Accuracy84.84
12
Multimodal Sentiment AnalysisCMU-MOSEI (0.5, 0.7, 0.3) (test)
Accuracy79.83
12
Multimodal Sentiment AnalysisCMU-MOSEI (0.3, 0.7, 0.5) (test)
Accuracy78.81
12
Multimodal RegressionCMU-MOSEI
7-Class Accuracy56.3
10
ClassificationCMU-MOSEI unaligned
Accuracy (2-class)32.02
10
Multimodal Sentiment AnalysisCMU-MOSEI OOD (test)
Accuracy (7-class)49.3
8
Multimodal Sentiment AnalysisCMU-MOSEI Unaligned
Accuracy (7-class)49.7
7
7-class emotion recognitionCMU-MOSEI
F1 (7-class)31
7
Multimodal Emotion Recognition in ConversationCMU-MOSEI standard (test)
Accuracy (ACC)46.82
7
Showing 25 of 36 rows