Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

CMU-MOSEI

Benchmarks

Task NameDataset NameSOTA ResultTrend
Multimodal Sentiment AnalysisCMU-MOSEI (test)
F1 Score91.7
332
Sentiment AnalysisCMU-MOSEI (test)
F1 Score87.26
96
Multimodal Emotion RecognitionCMU-MOSEI (test)
ACC754.5
56
Multimodal Sentiment AnalysisCMU-MOSEI
A2 Score87.3
27
Multimodal Sentiment AnalysisCMU-MOSEI (0.3, 0.5, 0.7) (test)
Accuracy84.76
24
Multimodal Sentiment AnalysisCMU-MOSEI segments (test)
ACC286.4
22
Emotion RecognitionCMU-MOSEI
F1 Score84
19
Emotion RecognitionCMU-MOSEI (test)
Accuracy (7)54.6
19
Multimodal Sentiment AnalysisCMU-MOSEI Unaligned (test)
Accuracy (2-Class)82.4
18
Multimodal Sentiment AnalysisCMU-MOSEI Word Aligned (test)
Accuracy (7-Class)51.8
14
Multimodal Sentiment AnalysisCMU-MOSEI BERT-based (test)
Accuracy (2-Class)85.7
14
Multimodal Sentiment AnalysisCMU-MOSEI (0.7, 0.5, 0.3) (test)
Accuracy82.53
12
Multimodal Sentiment AnalysisCMU-MOSEI (0.7, 0.3, 0.5) (test)
Accuracy84.84
12
Multimodal Sentiment AnalysisCMU-MOSEI (0.5, 0.7, 0.3) (test)
Accuracy79.83
12
Multimodal Sentiment AnalysisCMU-MOSEI (0.3, 0.7, 0.5) (test)
Accuracy78.81
12
Multimodal RegressionCMU-MOSEI
7-Class Accuracy56.3
10
ClassificationCMU-MOSEI unaligned
Accuracy (2-class)32.02
10
Multimodal Sentiment AnalysisCMU-MOSEI OOD (test)
Accuracy (7-class)49.3
8
7-class emotion recognitionCMU-MOSEI
F1 (7-class)31
7
Multimodal Emotion Recognition in ConversationCMU-MOSEI standard (test)
Accuracy (ACC)46.82
7
Multi-modal Sentiment Analysis Classification (MSAC)CMU-MOSEI
Class Negative (%)58.1
7
Multimodal Sentiment AnalysisCMU-MOSEI v1 (test)
Accuracy (2-Class)87.3
6
Sentiment AnalysisCMU-MOSEI
WF10.7766
6
Sentiment analysis and emotion recognitionCMU-MOSEI (test)
Inference Time (s)0.1
5
Multimodal Sentiment AnalysisCMU-MOSEI standard (test)
Accuracy81.14
5
Showing 25 of 30 rows