A More Fine-Grained Aspect-Sentiment-Opinion Triplet Extraction Task
About
Aspect Sentiment Triplet Extraction (ASTE) aims to extract aspect term, sentiment and opinion term triplets from sentences and tries to provide a complete solution for aspect-based sentiment analysis (ABSA). However, some triplets extracted by ASTE are confusing, since the sentiment in a triplet extracted by ASTE is the sentiment that the sentence expresses toward the aspect term rather than the sentiment of the aspect term and opinion term pair. In this paper, we introduce a more fine-grained Aspect-Sentiment-Opinion Triplet Extraction (ASOTE) Task. ASOTE also extracts aspect term, sentiment and opinion term triplets. However, the sentiment in a triplet extracted by ASOTE is the sentiment of the aspect term and opinion term pair. We build four datasets for ASOTE based on several popular ABSA benchmarks. We propose a Position-aware BERT-based Framework (PBF) to address this task. PBF first extracts aspect terms from sentences. For each extracted aspect term, PBF first generates aspect term-specific sentence representations considering both the meaning and the position of the aspect term, then extracts associated opinion terms and predicts the sentiments of the aspect term and opinion term pairs based on the sentence representations. Experimental results on the four datasets show the effectiveness of PBF.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| aspect sentiment triplet extraction | Rest SemEval 2014 (test) | F1 Score69.2 | 40 | |
| Opinion Term Extraction | 14res SemEval 2014 (test) | Precision85.9 | 37 | |
| aspect sentiment triplet extraction | Lap SemEval 2014 (test) | F1 Score56.3 | 34 | |
| aspect sentiment triplet extraction | Rest SemEval 2015 (test) | F1 Score58.8 | 34 | |
| aspect sentiment triplet extraction | Rest SemEval 2016 (test) | F1 Score66.5 | 34 | |
| Target-Oriented Opinion Word Extraction | 14lap SemEval 2014 (test) | Precision82.4 | 27 | |
| Target-Oriented Opinion Word Extraction | SemEval res 2016 (test) | Precision89.2 | 27 | |
| aspect sentiment triplet extraction | 14lap (test) | F1 Score55.8 | 25 | |
| aspect sentiment triplet extraction | 14res (test) | F1 Score69.2 | 17 | |
| aspect sentiment triplet extraction | 15res (test) | F1 Score58.5 | 17 |