Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Improving In-Context Learning with Prediction Feedback for Sentiment Analysis

About

Large language models (LLMs) have achieved promising results in sentiment analysis through the in-context learning (ICL) paradigm. However, their ability to distinguish subtle sentiments still remains a challenge. Inspired by the human ability to adjust understanding via feedback, this paper enhances ICL by incorporating prior predictions and feedback, aiming to rectify sentiment misinterpretation of LLMs. Specifically, the proposed framework consists of three steps: (1) acquiring prior predictions of LLMs, (2) devising predictive feedback based on correctness, and (3) leveraging a feedback-driven prompt to refine sentiment understanding. Experimental results across nine sentiment analysis datasets demonstrate the superiority of our framework over conventional ICL methods, with an average F1 improvement of 5.95%.

Hongling Xu, Qianlong Wang, Yice Zhang, Min Yang, Xi Zeng, Bing Qin, Ruifeng Xu• 2024

Related benchmarks

TaskDatasetResultRank
Sentiment ClassificationSST2 (test)
Accuracy92.49
214
Sentiment ClassificationSST-2--
174
Aspect Sentiment ClassificationLaptop (test)
Accuracy77.69
49
Aspect Polarity ClassificationTwitter
F1 Score (APC)57.78
17
Aspect-based Sentiment AnalysisTwitter (test)
Acc56.84
17
Aspect Sentiment ClassificationREST
F1 Score71.76
11
Aspect Sentiment ClassificationRest (test)
Accuracy81.83
11
Emotion DetectionEmoC
F1 Score53.72
11
Emotion DetectionTwEmo
F1 Score62.88
11
Emotion DetectionEmoC (test)
Accuracy78.37
11
Showing 10 of 20 rows

Other info

Code

Follow for update