RELBENCH
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Entity classification | RelBench rel-avito user-visits | AUC67.9 | 49 | |
| Entity Regression | RelBench v1.0 (test) | CTR (Avito Ad)18.4 | 45 | |
| Entity classification | RelBench rel-stack user-badge | AUC89 | 40 | |
| Entity Regression | RelBench V1 | Avito CTR Error (MAE)0.031 | 26 | |
| Binary Classification | RelBench 1.0 (test) | Relational Amazon User Churn72.03 | 26 | |
| Entity Classification | RELBENCH rel-amazon item-churn (test) | AUROC83.37 | 23 | |
| Entity Classification | RELBENCH rel-avito user-clicks (test) | AUROC71.31 | 22 | |
| Regression | RelBench v2 (test) | MAE (RateBeer User-Count)6.021 | 21 | |
| Entity classification | RelBench rel-stack user-engage | AUC90.6 | 21 | |
| Binary Classification | Relbench v1 | Avito Click AUROC68.36 | 20 | |
| Entity Classification | RELBENCH rel-f1 driver-top3 (test) | AUROC91.4 | 19 | |
| Entity Classification | RELBENCH rel-f1 driver-dnf (test) | AUROC0.812 | 19 | |
| Entity Classification | RELBENCH rel-avito user-visits (test) | AUROC0.6701 | 19 | |
| Entity Classification | RELBENCH rel-stack user-badge (test) | AUROC0.9 | 18 | |
| item-sales | RELBENCH rel-hm (test) | MAE0.052 | 16 | |
| driver-position | RELBENCH rel-f1 (test) | MAE3.539 | 16 | |
| user-attendance | RELBENCH rel-event (test) | MAE0.2423 | 16 | |
| ad-ctr | RELBENCH rel-avito (test) | MAE0.0362 | 16 | |
| user-ltv | RELBENCH rel-amazon (test) | MAE14.087 | 16 | |
| Entity classification | RelBench rel-avito user-clicks | AUC69.04 | 12 | |
| Entity Classification | RelBench V1 | DNF Score82.41 | 11 | |
| site-success | RELBENCH rel-trial (val) | MAE0.36 | 10 | |
| study-adverse | RELBENCH rel-trial (val) | MAE45.395 | 10 | |
| driver-position | RELBENCH rel-f1 (val) | MAE3.05 | 10 | |
| Entity Classification | RELBENCH rel-event (test) | AUROC0.8549 | 10 |
Showing 25 of 94 rows