Taobao
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| CTR Prediction | Taobao 1.68% compression | AUC71.66 | 35 | |
| Multi-behavior Recommendation | Taobao | HR@1013.43 | 32 | |
| Top-K Recommendation | Taobao | NDCG@100.231 | 23 | |
| CTR Prediction | Taobao latest 600 clicked items (test) | AUC63.88 | 18 | |
| Multi-behavior Sequential Recommendation | Taobao (test) | HR@570.5 | 16 | |
| Query Recommendation | Taobao (test) | Cate HR@3047.04 | 12 | |
| Retrieval | Taobao (test) | IC@200.363 | 12 | |
| Multi-behavior Recommendation | Taobao 1 (temporal split) | HR@100.1328 | 12 | |
| Sequential Recommendation | Taobao | AUC90.76 | 11 | |
| Sequential Recommendation | Taobao (test) | HR@1086.5 | 11 | |
| Recommendation | Taobao (test) | HR@100.1592 | 11 | |
| Multi-behavior Recommendation | Taobao (test) | HR@100.8515 | 11 | |
| Negative Recommendation | Taobao (test) | HR@203.3 | 10 | |
| Recommendation (PV) | Taobao | HR@202.87 | 10 | |
| Recommendation (Click) | Taobao | HR@2012.28 | 10 | |
| CTR Prediction | Taobao Evaluation Dataset (offline) | AUC69.63 | 10 | |
| CTR Prediction | Taobao | AUC0.6452 | 9 | |
| Auto-bidding | TaoBao real-world A/B (test) | GMV78,676,009 | 9 | |
| Next-item Prediction | Taobao Small | Hit@1003.26 | 9 | |
| Event Type Prediction | Taobao | Accuracy (ACC)59.7 | 7 | |
| Event Time Prediction | Taobao | RMSE0.21 | 7 | |
| CVR prediction | Taobao (streaming) | AUC100 | 7 | |
| Next-item Prediction | Taobao Large | Hit@1002.65 | 6 | |
| CTR Prediction | Taobao Offline (test) | AUC0.7894 | 6 | |
| Feature Engineering | Taobao held-out (test) | AUC67 | 5 |
Showing 25 of 33 rows