MIND
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| News Recommendation | MIND (test) | AUC72.68 | 75 | |
| Text Classification | MIND | Accuracy77.43 | 48 | |
| Recommendation | MIND (test) | Recall@2016.6 | 27 | |
| Text embedding | MIND | T-Value192.83 | 20 | |
| User simulation | MIND Real Exposure | Accuracy34.8 | 19 | |
| Federated Recommendation | MIND | Accuracy97.51 | 16 | |
| News Recommendation | MIND | AUC58.04 | 16 | |
| Recommendation | MIND | Accuracy81.96 | 16 | |
| Reranking | MindSmall (test) | MAP30.68 | 16 | |
| Ranking Recommendation | MIND | NDCG@1041.5 | 15 | |
| Negative Tag Controllable Recommendation | MIND | NDCG@109.67 | 14 | |
| Positive Tag Controllable Recommendation | MIND | NDCG@1048.6 | 14 | |
| Document Classification | MIND (test) | Accuracy0.8251 | 12 | |
| CTR Prediction | MIND (Offline) | AUC0.6713 | 8 | |
| Sequential Recommendation | MIND | NDCG@100.1146 | 8 | |
| Watermark Detection | MIND | Delta Cosine (%)87.74 | 7 | |
| Action Accuracy | MIND third-person view (test) | Trans. Error0.0106 | 6 | |
| Scene Reconstruction | MIND third-person view (test) | MSE0.0605 | 6 | |
| Action Accuracy | MIND first-person view (test) | Translation Error2.35 | 6 | |
| Scene Reconstruction | MIND first-person view (test) | MSE0.0614 | 6 | |
| 3D Geometry Consistency | MIND third-person view (test) | Reprojection Error61.26 | 4 | |
| 3D Geometry Consistency | MIND first-person view (test) | Reprojection Error53.95 | 4 | |
| World Modeling | MIND First 50 (test) | Context Memory11.88 | 3 | |
| World Modeling | MIND-Third 50 1.0 (test) | Long Context Memory0.1404 | 3 | |
| Watermarking | MIND (test) | P-Value0.1103 | 1 |
Showing 25 of 26 rows