Share your thoughts, 1 month free Claude Pro on usSee more

Task Addition on 8 classification datasets (Cars, DTD, EuroSAT, GTSRB, MNIST, RESISC45, SUN397, SVHN) (test)

90.41Absolute Accuracy

ATT-FT+OrthoReg

Updated 1mo ago

Evaluation Results

Method	Links
ATT-FT+OrthoReg 2026.04		90.41	100.05
LoRA-ATT+OrthoReg 2026.04		89.16	95.5
Non-lin. FT+OrthoReg 2026.04		88.23	100.08
Attention-Only Fine-tuning 2026.04		87.81	93.59
TTA+OrthoReg 2026.04		87.52	96.44
LoRA-ATT 2026.04		87.02	93.33
Tangent Task Arithmetic 2026.04		86.19	93.14
Non-linear Finetuning 2026.04		84.07	89.19
ATT-FT+OrthoReg 2026.04		83.37	98.77
ATT-FT+OrthoReg 2026.04		80.87	99.76
Attention-Only Fine-tuning 2026.04		80.71	87.64
TTA+OrthoReg 2026.04		79.85	88.02
LoRA-ATT+OrthoReg 2026.04		79.67	87.7
Tangent Task Arithmetic 2026.04		78.97	87.48
Attention-Only Fine-tuning 2026.04		78.07	86.99
Non-lin. FT+OrthoReg 2026.04		77.68	93.62
TTA+OrthoReg 2026.04		76.35	91.81
LoRA-ATT+OrthoReg 2026.04		76	86.1
LoRA-ATT 2026.04		75.51	83.17
Non-linear Finetuning 2026.04		75.39	75.39
Tangent Task Arithmetic 2026.04		74.68	85.27
LoRA-ATT 2026.04		73.84	84.29
Non-lin. FT+OrthoReg 2026.04		73.41	93.93
Non-linear Finetuning 2026.04		70.32	77.56
zero-shot 2026.04		64.54	-
zero-shot 2026.04		54.22	-
zero-shot 2026.04		47.74	-