vehicle

Benchmarks

Task Name	Dataset Name	SOTA Result
Classification	Vehicle	Accuracy85.6	65
Confidence Calibration	vehicle	Calibration Error0.001	44
Class Prior Estimation	Vehicle	Estimation Error1.6	36
Multi-class classification	Vehicle	F1-score83.7	20
Mislabel Detection	vehicle	AUROC0.853	17
Classification	vehicle	Cohen's Kappa0.989	16
Off-policy evaluation for classification error	vehicle	Bias-0.027	15
Classification	vehicle	ROC AUC100	14
Named Entity Recognition	Vehicle	F1 Score76	13
Identifying mislabeled points	vehicle	F1 Score21	12
Identifying mislabeled points	vehicle	Precision16	12
Identifying mislabeled points	vehicle	Recall32	12
Classification	Vehicle 10%	PR AUC95.8	12
Classification	Vehicle	PR AUC98.1	12
Counterfactual Explanation Generation	vehicle	Validity100	12
Classification	vehicle	Balanced Accuracy88.25	11
Multiclass Classification	vehicle	Weighted F1-score81	9
Multiclass imbalanced classification	vehicle	AUC94.2	9
Multiclass imbalanced classification	vehicle	Accuracy81.8	9
Multiclass Imbalanced Classification	vehicle	G-Mean79.8	9
Tabular Classification	vehicle 54 (test)	Test Error (%)11.1	9
Classification	Vehicle (UCI) (test)	NLL0.422	9
Inertial Odometry	Vehicle held-out (test)	ATE4.15	8
Clustering algorithm recommendation	Vehicle (UCI)	ARI13.8	8
Counterfactual Explanation	vehicle	Validity1	8

Showing 25 of 45 rows