GRACE: Gradient Harmonized and Cascaded Labeling for Aspect-based Sentiment Analysis
About
In this paper, we focus on the imbalance issue, which is rarely studied in aspect term extraction and aspect sentiment classification when regarding them as sequence labeling tasks. Besides, previous works usually ignore the interaction between aspect terms when labeling polarities. We propose a GRadient hArmonized and CascadEd labeling model (GRACE) to solve these problems. Specifically, a cascaded labeling module is developed to enhance the interchange between aspect terms and improve the attention of sentiment tokens when labeling sentiment polarities. The polarities sequence is designed to depend on the generated aspect terms labels. To alleviate the imbalance issue, we extend the gradient harmonized mechanism used in object detection to the aspect-based sentiment analysis by adjusting the weight of each label dynamically. The proposed GRACE adopts a post-pretraining BERT as its backbone. Experimental results demonstrate that the proposed model achieves consistency improvement on multiple benchmark datasets and generates state-of-the-art results.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Aspect term-polarity pair extraction | SemEval Restaurant (SR) (test) | F1 Score77.26 | 29 | |
| Aspect term-polarity pair extraction | SemEval Laptop (SL) (test) | F1 Score0.7071 | 28 | |
| Aspect Extraction | LAPTOP SemEval 2014 (test) | F1 Score87.93 | 28 | |
| Aspect Sentiment Pair Extraction | Lapt14 SemEval-2014 (test) | F1 Score75.97 | 15 | |
| Aspect Sentiment Pair Extraction | Rest SemEval 2014 (test) | F1 Score78.07 | 13 | |
| Aspect term-polarity pair extraction | Restaurant DR-15 SemEval 2015 (test) | F1 Score68.16 | 11 | |
| Aspect Term Extraction | DR Restaurant SemEval 2014 (test) | F1 Score85.45 | 10 | |
| Aspect term-polarity pair extraction | Laptop (D_L) | Precision72.38 | 9 | |
| Aspect term-polarity pair extraction | Restaurant (D_R) | Precision0.7595 | 9 | |
| Aspect term-polarity pair extraction | Twitter (D_T) | Precision58.36 | 9 |