Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

It is Simple Sometimes: A Study On Improving Aspect-Based Sentiment Analysis Performance

About

Aspect-Based Sentiment Analysis (ABSA) involves extracting opinions from textual data about specific entities and their corresponding aspects through various complementary subtasks. Several prior research has focused on developing ad hoc designs of varying complexities for these subtasks. In this paper, we present a generative framework extensible to any ABSA subtask. We build upon the instruction tuned model proposed by Scaria et al. (2023), who present an instruction-based model with task descriptions followed by in-context examples on ABSA subtasks. We propose PFInstruct, an extension to this instruction learning paradigm by appending an NLP-related task prefix to the task description. This simple approach leads to improved performance across all tested SemEval subtasks, surpassing previous state-of-the-art (SOTA) on the ATE subtask (Rest14) by +3.28 F1-score, and on the AOOE subtask by an average of +5.43 F1-score across SemEval datasets. Furthermore, we explore the impact of the prefix-enhanced prompt quality on the ABSA subtasks and find that even a noisy prefix enhances model performance compared to the baseline. Our method also achieves competitive results on a biomedical domain dataset (ERSA).

Laura Cabello, Uchenna Akujuobi• 2024

Related benchmarks

TaskDatasetResultRank
Aspect-level sentiment classificationSemEval Restaurant 2014 (test)--
67
Aspect-level sentiment classificationSemEval Laptop 2014 (test)--
59
Aspect Sentiment ClassificationRestaurant SemEval 2015 (test)--
32
Aspect Sentiment ClassificationRestaurant SemEval 2016 (test)
F1 Score92.51
27
Aspect-Opinion Pair ExtractionSemEval Cross-domain AOPE 2014, 2015, 2016 (test)
Average Score89.02
12
Entity Relationship Sentiment AnalysisERSA
F1-score70.31
5
Aspect Term ExtractionSemEval ATE subtask (test)
Laptop 201492.9
4
Aspect Term Sentiment ClassificationSentiHood
F1 Score95.11
3
Showing 8 of 8 rows

Other info

Code

Follow for update