CMU-MOSI
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multimodal Sentiment Analysis | CMU-MOSI (test) | F192.1 | 385 | |
| Multimodal Sentiment Analysis | CMU-MOSI | Accuracy (2-Class)90.1 | 166 | |
| Binary Sentiment Classification | CMU-MOSI (test) | F1 Score87.5 | 76 | |
| Multimodal Sentiment Analysis | CMU-MOSI v1 (test) | Accuracy (2-Class)91.2 | 72 | |
| Multimodal Sentiment Analysis | CMU-MOSI standard (test) | Accuracy87.2 | 62 | |
| Multimodal Sentiment Analysis | CMU-MOSI 43 (test) | 2-Class Accuracy88.9 | 56 | |
| Sentiment Analysis | CMU-MOSI | AUC77.02 | 54 | |
| Multimodal Emotion Recognition | CMU-MOSI (test) | ACC749.4 | 47 | |
| Multimodal Emotion Recognition | CMU-MOSI | ACC749.9 | 31 | |
| Multimodal Sentiment Analysis | CMU-MOSI Word Aligned (test) | Accuracy (7-Class)43.3 | 30 | |
| Multimodal Sentiment Analysis | CMU-MOSI cross-dataset evaluation (test) | Accuracy (2-class)85.5 | 28 | |
| Multimodal Sentiment Analysis | CMU-MOSI OOD (test) | 2-Class Accuracy87 | 24 | |
| Multimodal Sentiment Analysis | CMU-MOSI segments (test) | ACC286.5 | 22 | |
| Multimodal Sentiment Analysis | CMU-MOSI Unaligned (test) | Accuracy (7-Class)39.3 | 20 | |
| Multiclass Sentiment Classification | CMU-MOSI (test) | A753.9 | 16 | |
| Sentiment intensity prediction | CMU MOSI beta = 25% (test) | SRCC0.7 | 12 | |
| Sentiment intensity prediction | CMU MOSI beta = 10% (test) | SRCC0.734 | 12 | |
| Sentiment Regression | CMU-MOSI (test) | MAE0.71 | 11 | |
| Multimodal Regression | CMU-MOSI | Acc750.3 | 10 | |
| Emotion Recognition | CMU-MOSI | Weighted F185.8 | 10 | |
| Multimodal Sentiment Analysis | CMU-MOSI Transformer architecture (test) | Accuracy62.31 | 5 | |
| Zero-shot Cross-modal Robustness | CMU-MOSI (test) | Acc283.1 | 2 | |
| Multimodal Sentiment Analysis | CMU-MOSI (train) | Loss0.267 | 2 |
Showing 23 of 23 rows