Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Supervised Adversarial Contrastive Learning for Emotion Recognition in Conversations

About

Extracting generalized and robust representations is a major challenge in emotion recognition in conversations (ERC). To address this, we propose a supervised adversarial contrastive learning (SACL) framework for learning class-spread structured representations in a supervised manner. SACL applies contrast-aware adversarial training to generate worst-case samples and uses joint class-spread contrastive learning to extract structured representations. It can effectively utilize label-level feature consistency and retain fine-grained intra-class features. To avoid the negative impact of adversarial perturbations on context-dependent data, we design a contextual adversarial training (CAT) strategy to learn more diverse features from context and enhance the model's context robustness. Under the framework with CAT, we develop a sequence-based SACL-LSTM to learn label-consistent and context-robust features for ERC. Experiments on three datasets show that SACL-LSTM achieves state-of-the-art performance on ERC. Extended experiments prove the effectiveness of SACL and CAT.

Dou Hu, Yinan Bao, Lingwei Wei, Wei Zhou, Songlin Hu• 2023

Related benchmarks

TaskDatasetResultRank
Emotion Recognition in ConversationIEMOCAP (test)
Weighted Average F1 Score69.22
154
Emotion Recognition in ConversationMELD
Weighted Avg F166.45
137
Conversational Emotion RecognitionIEMOCAP
Weighted Average F1 Score69.22
129
Emotion Recognition in ConversationMELD (test)
Weighted F166.45
118
Emotion DetectionEmoryNLP (test)
Weighted-F10.3965
96
Dialogue Emotion DetectionEmoryNLP
Weighted Avg F139.65
80
Multimodal Emotion Recognition in ConversationMELD standard (test)
WF164.55
38
Multimodal Emotion Recognition in ConversationIEMOCAP 6-class (test)
Weighted F1 Score (WF1)70.6
33
Emotion Recognition in ConversationMELD standard (test)
Weighted F166.45
19
Multimodal Emotion Recognition in ConversationIEMOCAP 4-class (test)
F1 Score (Weighted)80.74
8
Showing 10 of 15 rows

Other info

Code

Follow for update