Instruction Tuning for Few-Shot Aspect-Based Sentiment Analysis
About
Aspect-based Sentiment Analysis (ABSA) is a fine-grained sentiment analysis task which involves four elements from user-generated texts: aspect term, aspect category, opinion term, and sentiment polarity. Most computational approaches focus on some of the ABSA sub-tasks such as tuple (aspect term, sentiment polarity) or triplet (aspect term, opinion term, sentiment polarity) extraction using either pipeline or joint modeling approaches. Recently, generative approaches have been proposed to extract all four elements as (one or more) quadruplets from text as a single task. In this work, we take a step further and propose a unified framework for solving ABSA, and the associated sub-tasks to improve the performance in few-shot scenarios. To this end, we fine-tune a T5 model with instructional prompts in a multi-task learning fashion covering all the sub-tasks, as well as the entire quadruple prediction task. In experiments with multiple benchmark datasets, we show that the proposed multi-task prompting approach brings performance boost (by absolute 8.29 F1) in the few-shot learning setting.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| aspect sentiment triplet extraction | Rest SemEval 2014 (test) | F1 Score43.84 | 40 | |
| Aspect Extraction | LAPTOP SemEval 2014 (test) | F1 Score76.93 | 28 | |
| aspect sentiment triplet extraction | Rest 15 (test) | F1 Score52.94 | 26 | |
| Aspect Term Extraction (ATE) | SemEval Restaurant 2016 (test) | F1 Score79.41 | 18 | |
| Aspect Term Extraction (ATE) | SemEval Restaurant 2015 (test) | F1 Score0.7403 | 18 | |
| Aspect Term Extraction | Laptop 2014 (test) | F1 Score76.93 | 17 | |
| Aspect Sentiment Pair Extraction | Lapt14 SemEval-2014 (test) | F1 Score66.07 | 15 | |
| Aspect Extraction | Rest SemEval 2016 (test) | F1 Score79.41 | 12 | |
| Aspect Sentiment Pair Extraction | Rest SemEval 2015 (test) | ASP F1 Score67.06 | 11 | |
| Aspect Sentiment Pair Extraction | Rest SemEval 2016 (test) | F1 Score74.07 | 9 |