RELBENCH
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Entity Regression | RelBench v1.0 (test) | CTR (Avito Ad)18.4 | 45 | |
| Entity classification | RelBench rel-avito user-visits | AUC66.8 | 36 | |
| Entity classification | RelBench rel-stack user-badge | AUC89 | 27 | |
| Binary Classification | RelBench 1.0 (test) | Relational Amazon User Churn72.03 | 26 | |
| Entity Classification | RELBENCH rel-amazon item-churn (test) | AUROC83.37 | 23 | |
| Entity Classification | RELBENCH rel-avito user-clicks (test) | AUROC71.31 | 22 | |
| Entity Classification | RELBENCH rel-f1 driver-top3 (test) | AUROC91.4 | 19 | |
| Entity Classification | RELBENCH rel-f1 driver-dnf (test) | AUROC0.812 | 19 | |
| Entity Classification | RELBENCH rel-avito user-visits (test) | AUROC0.6701 | 19 | |
| Entity Classification | RELBENCH rel-stack user-badge (test) | AUROC0.9 | 18 | |
| item-sales | RELBENCH rel-hm (test) | MAE0.052 | 16 | |
| driver-position | RELBENCH rel-f1 (test) | MAE3.539 | 16 | |
| user-attendance | RELBENCH rel-event (test) | MAE0.2423 | 16 | |
| ad-ctr | RELBENCH rel-avito (test) | MAE0.0362 | 16 | |
| user-ltv | RELBENCH rel-amazon (test) | MAE14.087 | 16 | |
| Regression | RelBench v2 (test) | MAE (RateBeer User-Count)6.021 | 13 | |
| Entity classification | RelBench rel-avito user-clicks | AUC69.04 | 12 | |
| Entity Regression | RelBench V1 | F1 Positive Error (MAE)2.747 | 11 | |
| Entity Classification | RelBench V1 | DNF Score82.41 | 11 | |
| Entity Classification | RELBENCH rel-event (test) | AUROC0.8549 | 10 | |
| Entity Classification | RELBENCH rel-event user-repeat (test) | AUROC79.26 | 10 | |
| site-success | RELBENCH rel-trial (test) | MAE0.397 | 9 | |
| study-adverse | RELBENCH rel-trial (test) | MAE43.682 | 9 | |
| post-votes | RELBENCH rel-stack (test) | MAE0.062 | 9 | |
| item-ltv | RELBENCH rel-amazon (test) | MAE48.224 | 9 |
Showing 25 of 75 rows