Shuttle

Benchmarks

Task Name	Dataset Name	SOTA Result
Anomaly Detection	shuttle	AUC1	61
kNN Classification	Shuttle	Accuracy99.7	35
Online Class-Incremental Learning	Shuttle	Final Mean Accuracy78.3	26
Tabular Anomaly Detection	Shuttle	AUC-ROC1	23
Clustering	Shuttle	ARI0.689	20
Constrained Clustering	shuttle	Success Rate100	18
Clustering	shuttle	CPU Time0.68	18
Clustering	shuttle	Clustering Inertia293,144.76	18
Outlier Detection	shuttle (historical)	AUROC99.83	17
Outlier Detection	shuttle Group II	AUROC (%)99.51	14
Classification	shuttle	Balanced Accuracy99.7	14
Online Class Incremental Learning	Shuttle	Average Forgetting0	11
Anomaly Detection	shuttle In-Domain	F1 Score98.55	10
Streaming Class-Incremental Learning	Shuttle	Accuracy (EN)91.6	10
Multi-class Classification	Shuttle	Average G-mean0.824	10
Multiclass Classification	shuttle	Weighted F11	9
Multiclass imbalanced classification	shuttle	AUC1	9
Multiclass Imbalanced Classification	shuttle	G-Mean1	9
Classification	Shuttle	Accuracy99.83	8
Clustering	Shuttle (UCI)	ARI57.03	8
Drift Detection	Shuttle Real	Accuracy99.44	8
Nonstationary backward transfer	Shuttle	BWT ARI0.183	7
Incremental Clustering	Shuttle	Avg Inc ARI0.532	7
Classification	Shuttle unseen future domain	Error Rate0.24	7
Tabular Classification	shuttle small-d 16	Performance Score74.8	6

Showing 25 of 36 rows