Amazon Review
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Text Classification | Amazon Review Polarity (AMZP) | Accuracy96.7 | 57 | |
| Text Classification | Amazon Review Full | Accuracy65.2 | 33 | |
| Recommendation | Amazon Review Toys (test) | AUC0.7985 | 30 | |
| Recommendation | Amazon Review Beauty (test) | AUC0.8189 | 30 | |
| Recommendation | Amazon Review Sports (test) | AUC82.4 | 30 | |
| Text Classification | Amazon Review Full (test) | Accuracy62.85 | 25 | |
| CTR prediction | Amazon-Review Automotive (test) | AUC0.654 | 20 | |
| CTR prediction | Amazon-Review Beauty (test) | AUC0.634 | 20 | |
| CTR prediction | Amazon-Review Appliances (test) | AUC0.688 | 20 | |
| Text Classification | Amazon Review 1000 labels (test) | Top-1 Error Rate39.17 | 19 | |
| Text Classification | Amazon Review 250 labels (test) | Top-1 Error Rate42.98 | 19 | |
| Text Classification | Amazon Review (test) | Macro F1 Score63.85 | 18 | |
| Document Classification | Amazon Review EN | Accuracy80.03 | 16 | |
| Semi-supervised learning | Amazon Review | Error Rate40.16 | 16 | |
| Sentence Classification | Amazon Review (test) | Accuracy92.94 | 15 | |
| Event sequence modeling | Amazon Review | Accuracy (%)70 | 13 | |
| Sequential Recommendation | Amazon Review Office v1 (test) | R@19.72 | 11 | |
| Sequential Recommendation | Amazon Review Industrial v1 (test) | R@19.04 | 11 | |
| Sequential Recommendation | Amazon Review Toys v1 (test) | Recall@14.71 | 11 | |
| Next-item prediction | Amazon Review Office (test) | HR@313.44 | 11 | |
| Next-item prediction | Amazon Review Industrial (test) | HR@30.1189 | 11 | |
| Cross-lingual Topic Modeling | Amazon Review | CNPMI0.072 | 10 | |
| Multi-class Classification | Amazon Review (AR) | Accuracy44.06 | 10 | |
| Error Detection | Amazon Review | F1 Score0.453 | 10 | |
| Accuracy Estimation | Amazon Review | Absolute Estimation Error0.018 | 10 |
Showing 25 of 53 rows