Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Reasoning Implicit Sentiment with Chain-of-Thought Prompting

About

While sentiment analysis systems try to determine the sentiment polarities of given targets based on the key opinion expressions in input texts, in implicit sentiment analysis (ISA) the opinion cues come in an implicit and obscure manner. Thus detecting implicit sentiment requires the common-sense and multi-hop reasoning ability to infer the latent intent of opinion. Inspired by the recent chain-of-thought (CoT) idea, in this work we introduce a Three-hop Reasoning (THOR) CoT framework to mimic the human-like reasoning process for ISA. We design a three-step prompting principle for THOR to step-by-step induce the implicit aspect, opinion, and finally the sentiment polarity. Our THOR+Flan-T5 (11B) pushes the state-of-the-art (SoTA) by over 6% F1 on supervised setup. More strikingly, THOR+GPT3 (175B) boosts the SoTA by over 50% F1 on zero-shot setting. Our code is open at https://github.com/scofield7419/THOR-ISA.

Hao Fei, Bobo Li, Qian Liu, Lidong Bing, Fei Li, Tat-Seng Chua• 2023

Related benchmarks

TaskDatasetResultRank
Commonsense ReasoningCommonsense Reasoning--
44
Aspect-level Sentiment AnalysisLaptop L (test)
Accuracy82.29
24
Aspect-based Sentiment AnalysisRestaurant14 original (test)
Accuracy88.57
20
Aspect-based Sentiment AnalysisLaptop14 original (test)
Accuracy82.29
20
Aspect-based Sentiment AnalysisSemEval Restaurant 2014 (All)
F1 Score87.45
19
Aspect-based Sentiment AnalysisSemEval Laptop 2014
F1 Score85.16
19
Implicit Sentiment AnalysisRestaurant14 ISA original (test)
Accuracy73.03
19
Implicit Sentiment AnalysisLaptop14 ISA original (test)
Accuracy76.57
19
Aspect-level Sentiment AnalysisSemEval Task 4 Laptop 2014 (test)
Accuracy76.57
19
Aspect-based Sentiment AnalysisRestaurant Implicit Sentiment Analysis (test)
Accuracy73.03
14
Showing 10 of 17 rows

Other info

Code

Follow for update