Supervised Adversarial Contrastive Learning for Emotion Recognition in Conversations
About
Extracting generalized and robust representations is a major challenge in emotion recognition in conversations (ERC). To address this, we propose a supervised adversarial contrastive learning (SACL) framework for learning class-spread structured representations in a supervised manner. SACL applies contrast-aware adversarial training to generate worst-case samples and uses joint class-spread contrastive learning to extract structured representations. It can effectively utilize label-level feature consistency and retain fine-grained intra-class features. To avoid the negative impact of adversarial perturbations on context-dependent data, we design a contextual adversarial training (CAT) strategy to learn more diverse features from context and enhance the model's context robustness. Under the framework with CAT, we develop a sequence-based SACL-LSTM to learn label-consistent and context-robust features for ERC. Experiments on three datasets show that SACL-LSTM achieves state-of-the-art performance on ERC. Extended experiments prove the effectiveness of SACL and CAT.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Emotion Recognition in Conversation | IEMOCAP (test) | Weighted Average F1 Score69.22 | 154 | |
| Emotion Recognition in Conversation | MELD | Weighted Avg F166.45 | 137 | |
| Conversational Emotion Recognition | IEMOCAP | Weighted Average F1 Score69.22 | 129 | |
| Emotion Recognition in Conversation | MELD (test) | Weighted F166.45 | 118 | |
| Emotion Detection | EmoryNLP (test) | Weighted-F10.3965 | 96 | |
| Dialogue Emotion Detection | EmoryNLP | Weighted Avg F139.65 | 80 | |
| Multimodal Emotion Recognition in Conversation | MELD standard (test) | WF164.55 | 38 | |
| Multimodal Emotion Recognition in Conversation | IEMOCAP 6-class (test) | Weighted F1 Score (WF1)70.6 | 33 | |
| Emotion Recognition in Conversation | MELD standard (test) | Weighted F166.45 | 19 | |
| Multimodal Emotion Recognition in Conversation | IEMOCAP 4-class (test) | F1 Score (Weighted)80.74 | 8 |