Model Calibration on SVHN

0.24ECE

BalCAL

Updated 3d ago

Evaluation Results

Method
BalCAL 2025.04	0.24	-	-	-	95.47	0.33
TST 2025.04	0.43	-	-	-	95.1	-
VTST 2025.04	0.48	-	-	-	94.73	-
MIT 2025.04	0.78	-	-	-	93.69	0.68
FLSD 2025.04	1.03	-	-	-	94.6	0.92
FL 2025.04	1.24	-	-	-	94.79	1.26
CPC 2025.04	1.61	-	-	-	94.73	1.45
MMCE 2025.04	2.3	-	-	-	93.99	2.31
Base 2023.04	2.32	-	-	-	-	-
GPC 2023.04	2.32	-	-	-	-	-
IROVA 2023.04	2.63	-	-	-	-	-
ACLS 2025.04	3.2	-	-	-	95.33	3.19
Vanilla 2025.04	3.32	-	-	-	95.12	3.31
ETS 2023.04	3.33	-	-	-	-	-
PLP 2025.04	3.49	-	-	-	95.07	3.49
Mixup 2025.04	3.75	-	-	-	94.82	3.57
LS 2025.04	3.77	-	-	-	95.5	3.93
TS 2023.04	3.95	-	-	-	-	-
IR 2023.04	4.51	-	-	-	-	-
Knowledge-Transferring-based Temperature Scaling 2023.04	4.53	-	-	-	-	-
IROVA 2023.04	5.31	-	-	-	-	-
GPC 2023.04	5.31	-	-	-	-	-
Base 2023.04	5.75	-	-	-	-	-
Knowledge-Transferring-based Temperature Scaling 2023.04	6.09	-	-	-	-	-
TS 2023.04	6.76	-	-	-	-	-
ETS 2023.04	6.94	-	-	-	-	-
SBC 2023.04	7	-	-	-	-	-
TS 2023.04	7.2	-	-	-	-	-
Knowledge-Transferring-based Temperature Scaling 2023.04	7.43	-	-	-	-	-
TS-IR 2023.04	8.1	-	-	-	-	-
SBC 2023.04	9.43	-	-	-	-	-
SBC 2023.04	9.59	-	-	-	-	-
TS-IR 2023.04	11.42	-	-	-	-	-
ETS 2023.04	11.62	-	-	-	-	-
IR 2023.04	12.15	-	-	-	-	-
GPC 2023.04	13.67	-	-	-	-	-
IROVA 2023.04	14.93	-	-	-	-	-
Base 2023.04	16.06	-	-	-	-	-
TS-IR 2023.04	21.25	-	-	-	-	-
IR 2023.04	22.18	-	-	-	-	-
Softmax Temperature Tuning 2018.12	-	22.3	10.9	52.1	-	-
Softmax Temperature Tuning + OE 2018.12	-	4.8	2.4	87.9	-	-