Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Instruction Tuning for Few-Shot Aspect-Based Sentiment Analysis

About

Aspect-based Sentiment Analysis (ABSA) is a fine-grained sentiment analysis task which involves four elements from user-generated texts: aspect term, aspect category, opinion term, and sentiment polarity. Most computational approaches focus on some of the ABSA sub-tasks such as tuple (aspect term, sentiment polarity) or triplet (aspect term, opinion term, sentiment polarity) extraction using either pipeline or joint modeling approaches. Recently, generative approaches have been proposed to extract all four elements as (one or more) quadruplets from text as a single task. In this work, we take a step further and propose a unified framework for solving ABSA, and the associated sub-tasks to improve the performance in few-shot scenarios. To this end, we fine-tune a T5 model with instructional prompts in a multi-task learning fashion covering all the sub-tasks, as well as the entire quadruple prediction task. In experiments with multiple benchmark datasets, we show that the proposed multi-task prompting approach brings performance boost (by absolute 8.29 F1) in the few-shot learning setting.

Siddharth Varia, Shuai Wang, Kishaloy Halder, Robert Vacareanu, Miguel Ballesteros, Yassine Benajiba, Neha Anna John, Rishita Anubhai, Smaranda Muresan, Dan Roth• 2022

Related benchmarks

TaskDatasetResultRank
aspect sentiment triplet extractionRest SemEval 2014 (test)
F1 Score43.84
40
Aspect ExtractionLAPTOP SemEval 2014 (test)
F1 Score76.93
28
aspect sentiment triplet extractionRest 15 (test)
F1 Score52.94
26
Aspect Term Extraction (ATE)SemEval Restaurant 2016 (test)
F1 Score79.41
18
Aspect Term Extraction (ATE)SemEval Restaurant 2015 (test)
F1 Score0.7403
18
Aspect Term ExtractionLaptop 2014 (test)
F1 Score76.93
17
Aspect Sentiment Pair ExtractionLapt14 SemEval-2014 (test)
F1 Score66.07
15
Aspect ExtractionRest SemEval 2016 (test)
F1 Score79.41
12
Aspect Sentiment Pair ExtractionRest SemEval 2015 (test)
ASP F1 Score67.06
11
Aspect Sentiment Pair ExtractionRest SemEval 2016 (test)
F1 Score74.07
9
Showing 10 of 12 rows

Other info

Follow for update