CatBoost: gradient boosting with categorical features support
About
In this paper we present CatBoost, a new open-sourced gradient boosting library that successfully handles categorical features and outperforms existing publicly available implementations of gradient boosting in terms of quality on a set of popular publicly available datasets. The library has a GPU implementation of learning algorithm and a CPU implementation of scoring algorithm, which are significantly faster than other gradient boosting libraries on ensembles of similar sizes.
Anna Veronika Dorogush, Vasily Ershov, Andrey Gulin• 2018
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Classification | blood-transfusion | AUROC70.9 | 23 | |
| Classification | Petfinder (test) | Accuracy38.69 | 16 | |
| Classification | christine 41142 | AUROC82.2 | 15 | |
| Classification | jasmine 41143 | AUROC87 | 15 | |
| Classification | kc1 1067 | AUROC80 | 15 | |
| Classification | Adult | ROC-AUC0.93 | 13 | |
| Tabular Classification | TabArena | -- | 12 | |
| Regression | Crossed Barrel Dataset (80% uniform sampling) | R^20.76 | 10 | |
| Regression | Cogni-e-Spin Dataset (80% uniform sampling) | R^20.55 | 10 | |
| Surrogate Modeling | Crossed Barrel Dataset biased sampling | R^20.55 | 10 |
Showing 10 of 35 rows