Share your thoughts, 1 month free Claude Pro on usSee more

Multiple Choice on COPA

100Accuracy

Full Fine-Tuning (FT)

Updated 1mo ago

Evaluation Results

Method	Links
Full Fine-Tuning (FT) 2025.12		100
LoRA 2025.12		100
Partial-LoRA 2025.12		100
Masking (0.001%) 2025.12		98
Partial-LoRA 2025.12		90
Full Fine-Tuning (FT) 2025.12		90
LoRA 2025.12		89
Masking (0.001%) 2025.12		88
Partial-LoRA 2025.12		88
AR1-ZO 2026.05		88
MeZO LoRA 2026.06		88
Full Fine-Tuning (FT) 2025.12		87
Dominant-layer ZO FT 2026.06		87
Dominant-layer ZO LoRA 2026.06		87
LOZO 2026.05		86
AR1-ZO 2026.05		86
First Order Adamw FT 2026.06		86
MeZO FT 2026.06		86
LoRA 2025.12		85
MeZO-LoRA 2026.05		84
FT (Adam) 2026.05		81
Zero-shot w/o finetune 2026.06		81
LOZO 2026.05		80
AR1-ZO 2026.05		79
FT (Adam) 2026.05		79
CAQ-ZO 2026.05		78.4
MeZO 2026.05		78
Zero-Shot-Q 2026.05		78
QuZO 2026.05		77.9
MeZO-LoRA 2026.05		77
CAQ-ZO 2026.05		76.2
Masking (0.001%) 2025.12		76
MeZO 2026.05		75.1
ZO-Alt-Naive 2026.05		75
Zero-Shot-Q 2026.05		73
ZO-Alt-Naive 2026.05		73
MeZO-LoRA 2026.05		72
AR1-ZO 2026.05		72
ZO-Alt-Naive 2026.05		71
MeZO-LoRA 2026.05		71
ZO-Alt-Naive 2026.05		71
QuZO 2026.05		63.9