It is Simple Sometimes: A Study On Improving Aspect-Based Sentiment Analysis Performance
About
Aspect-Based Sentiment Analysis (ABSA) involves extracting opinions from textual data about specific entities and their corresponding aspects through various complementary subtasks. Several prior research has focused on developing ad hoc designs of varying complexities for these subtasks. In this paper, we present a generative framework extensible to any ABSA subtask. We build upon the instruction tuned model proposed by Scaria et al. (2023), who present an instruction-based model with task descriptions followed by in-context examples on ABSA subtasks. We propose PFInstruct, an extension to this instruction learning paradigm by appending an NLP-related task prefix to the task description. This simple approach leads to improved performance across all tested SemEval subtasks, surpassing previous state-of-the-art (SOTA) on the ATE subtask (Rest14) by +3.28 F1-score, and on the AOOE subtask by an average of +5.43 F1-score across SemEval datasets. Furthermore, we explore the impact of the prefix-enhanced prompt quality on the ABSA subtasks and find that even a noisy prefix enhances model performance compared to the baseline. Our method also achieves competitive results on a biomedical domain dataset (ERSA).
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Aspect-level sentiment classification | SemEval Restaurant 2014 (test) | -- | 67 | |
| Aspect-level sentiment classification | SemEval Laptop 2014 (test) | -- | 59 | |
| Aspect Sentiment Classification | Restaurant SemEval 2015 (test) | -- | 32 | |
| Aspect Sentiment Classification | Restaurant SemEval 2016 (test) | F1 Score92.51 | 27 | |
| Aspect-Opinion Pair Extraction | SemEval Cross-domain AOPE 2014, 2015, 2016 (test) | Average Score89.02 | 12 | |
| Entity Relationship Sentiment Analysis | ERSA | F1-score70.31 | 5 | |
| Aspect Term Extraction | SemEval ATE subtask (test) | Laptop 201492.9 | 4 | |
| Aspect Term Sentiment Classification | SentiHood | F1 Score95.11 | 3 |