Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

InstructERC: Reforming Emotion Recognition in Conversation with Multi-task Retrieval-Augmented Large Language Models

About

The field of emotion recognition of conversation (ERC) has been focusing on separating sentence feature encoding and context modeling, lacking exploration in generative paradigms based on unified designs. In this study, we propose a novel approach, InstructERC, to reformulate the ERC task from a discriminative framework to a generative framework based on Large Language Models (LLMs). InstructERC makes three significant contributions: (1) it introduces a simple yet effective retrieval template module, which helps the model explicitly integrate multi-granularity dialogue supervision information. (2) We introduce two additional emotion alignment tasks, namely speaker identification and emotion prediction tasks, to implicitly model the dialogue role relationships and future emotional tendencies in conversations. (3) Pioneeringly, we unify emotion labels across benchmarks through the feeling wheel to fit real application scenarios. InstructERC still perform impressively on this unified dataset. Our LLM-based plugin framework significantly outperforms all previous models and achieves comprehensive SOTA on three commonly used ERC datasets. Extensive analysis of parameter-efficient and data-scaling experiments provides empirical guidance for applying it in practical scenarios.

Shanglin Lei, Guanting Dong, Xiaoping Wang, Keheng Wang, Runqi Qiao, Sirui Wang• 2023

Related benchmarks

TaskDatasetResultRank
Emotion Recognition in ConversationIEMOCAP (test)
Weighted Average F1 Score71.39
154
Emotion Recognition in ConversationMELD
Weighted Avg F169.15
137
Conversational Emotion RecognitionIEMOCAP
Weighted Average F1 Score71.39
129
Emotion Recognition in ConversationMELD (test)
Weighted F169.15
118
Emotion DetectionEmoryNLP (test)
Weighted-F10.4139
96
Dialogue Emotion DetectionEmoryNLP
Weighted Avg F141.37
80
Emotion ClassificationIEMOCAP (test)
Weighted-F171.75
36
Emotion RecognitionMELD (test)--
26
Emotion Recognition in ConversationMELD standard (test)
Weighted F169.15
19
Speech Emotion RecognitionMELD → IEMOCAP Cross-Domain
Weighted F143.36
14
Showing 10 of 12 rows

Other info

Follow for update