RELBENCH
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Entity classification | RelBench rel-avito user-visits | AUC66.8 | 32 | |
| Entity Regression | RelBench v1.0 (test) | LTV (Amazon Item)66.436 | 27 | |
| Binary Classification | RelBench 1.0 (test) | Relational Amazon User Churn72.03 | 26 | |
| Entity classification | RelBench rel-stack user-badge | AUC86.32 | 23 | |
| Entity Classification | RELBENCH rel-amazon item-churn (test) | AUROC83.37 | 23 | |
| Entity Classification | RELBENCH rel-stack user-badge (test) | AUROC0.8964 | 15 | |
| Entity Classification | RELBENCH rel-f1 driver-top3 (test) | AUROC91.4 | 15 | |
| Entity Classification | RELBENCH rel-f1 driver-dnf (test) | AUROC0.812 | 15 | |
| Entity Classification | RELBENCH rel-avito user-clicks (test) | AUROC71.31 | 15 | |
| Entity Classification | RELBENCH rel-avito user-visits (test) | AUROC0.6701 | 15 | |
| site-success | RELBENCH rel-trial (test) | MAE0.397 | 9 | |
| study-adverse | RELBENCH rel-trial (test) | MAE43.682 | 9 | |
| post-votes | RELBENCH rel-stack (test) | MAE0.062 | 9 | |
| item-sales | RELBENCH rel-hm (test) | MAE0.052 | 9 | |
| driver-position | RELBENCH rel-f1 (test) | MAE3.539 | 9 | |
| user-attendance | RELBENCH rel-event (test) | MAE0.251 | 9 | |
| ad-ctr | RELBENCH rel-avito (test) | MAE0.037 | 9 | |
| item-ltv | RELBENCH rel-amazon (test) | MAE48.224 | 9 | |
| user-ltv | RELBENCH rel-amazon (test) | MAE14.087 | 9 | |
| site-success regression | RelBench rel-trial (test) | R2 Score5.5 | 8 | |
| Entity classification | RelBench rel-trial study-outcome | AUC71.58 | 8 | |
| Entity classification | RelBench rel-stack user-engage | AUC90.53 | 8 | |
| Entity classification | RelBench rel-hm user-churn | AUC69.27 | 8 | |
| Entity classification | RelBench rel-avito user-clicks | AUC69.04 | 8 | |
| Entity classification | RelBench rel-avito user-churn | AUC0.7039 | 8 |
Showing 25 of 55 rows