REST
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Aspect Sentiment Classification | Rest SemEval 2014 (test) | Accuracy91.32 | 73 | |
| Aspect Sentiment Quad Prediction | Rest16 | F1 Score64.21 | 46 | |
| Aspect Sentiment Quad Prediction | Rest15 | F1 Score54.73 | 46 | |
| Aspect Sentiment Triplet Extraction | Rest SemEval 2014 (test) | F1 Score76.3 | 40 | |
| Aspect Sentiment Triplet Extraction | Rest SemEval 2016 (test) | F1 Score71.7 | 34 | |
| Aspect Sentiment Triplet Extraction | Rest SemEval 2015 (test) | F1 Score63.27 | 34 | |
| Aspect Sentiment Triplet Extraction | 16Rest ASTE-DATA-V2 (test) | Precision72.2 | 32 | |
| Aspect Sentiment Triplet Extraction | 15Rest ASTE-DATA-V2 (test) | Precision69.9 | 32 | |
| Aspect Sentiment Triplet Extraction | 14Rest ASTE-DATA-V2 (test) | Precision76.4 | 32 | |
| Aspect-based Sentiment Classification | 15Rest SemEval-2015 (test) | Accuracy0.9079 | 32 | |
| Target Aspect Sentiment Detection | Rest 2016 | F1 Score72.76 | 31 | |
| Aspect-based Sentiment Classification | Rest SemEval-2016 (test) | Accuracy94.62 | 28 | |
| Aspect Sentiment Triplet Extraction | Rest 15 (test) | F1 Score69.44 | 26 | |
| Aspect-level sentiment analysis | Rest 14 | Accuracy90.86 | 25 | |
| Aspect Sentiment Quad Prediction | Rest15 (test) | F1 Score0.5221 | 25 | |
| Aspect Sentiment Triplet Extraction | 16Rest ASTE-Data-V1 (test) | F1 Score73.48 | 25 | |
| Sequence Labeling | Rest14 (test) | Micro F183.64 | 23 | |
| Aspect-level sentiment analysis | Rest15 | Accuracy85.61 | 23 | |
| Aspect-level sentiment analysis | Rest16 | Accuracy93.02 | 22 | |
| Aspect-Sentiment-Query-Pair Extraction | Rest 16 | F1 Score59.79 | 21 | |
| Aspect-Sentiment-Query-Pair Extraction | Rest15 | F1 Score48.18 | 21 | |
| Target-Aspect-Sentiment Detection | Rest15 | F1 Score63.06 | 21 | |
| Aspect Sentiment Quad Prediction | Rest16 (test) | F1 Score60.39 | 21 | |
| Aspect-Based Sentiment Analysis | Rest 14 | Accuracy88.11 | 18 | |
| Aspect-Opinion-Sentiment Triplet Extraction | Rest 16 | F1 Score84.52 | 17 |
Showing 25 of 49 rows