COSMIC: COmmonSense knowledge for eMotion Identification in Conversations
About
In this paper, we address the task of utterance level emotion recognition in conversations using commonsense knowledge. We propose COSMIC, a new framework that incorporates different elements of commonsense such as mental states, events, and causal relations, and build upon them to learn interactions between interlocutors participating in a conversation. Current state-of-the-art methods often encounter difficulties in context propagation, emotion shift detection, and differentiating between related emotion classes. By learning distinct commonsense representations, COSMIC addresses these challenges and achieves new state-of-the-art results for emotion recognition on four different benchmark conversational datasets. Our code is available at https://github.com/declare-lab/conv-emotion.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Emotion Recognition in Conversation | IEMOCAP (test) | Weighted Average F1 Score65.28 | 154 | |
| Emotion Recognition in Conversation | MELD | Weighted Avg F165.21 | 137 | |
| Conversational Emotion Recognition | IEMOCAP | Weighted Average F1 Score65.25 | 129 | |
| Emotion Recognition in Conversation | MELD (test) | Weighted F165.21 | 118 | |
| Emotion Detection | EmoryNLP (test) | Weighted-F10.3849 | 96 | |
| Dialogue Emotion Detection | EmoryNLP | Weighted Avg F138.11 | 80 | |
| Emotion Recognition | IEMOCAP | -- | 71 | |
| Emotion Detection | DailyDialog (test) | Micro-F10.5848 | 53 | |
| Emotion Classification | IEMOCAP (test) | Weighted-F165.28 | 36 | |
| Multimodal Emotion Recognition | IEMOCAP 6-way | F1 (Avg)65.38 | 28 |