Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Fine-tuning on Alpaca (test)
Loading...
7.3804
Test Perplexity
Adam-mini
7.277388
7.972719
8.66805
9.363381
May 6, 2026
Test Perplexity
Updated 27d ago
Evaluation Results
Method
Method
Links
Test Perplexity
Adam-mini
Model=Llama_3.2_1B, St...
2026.05
7.3804
AdamW16
Model=Llama_3.2_1B, St...
2026.05
7.7593
BAOC0.5
Model=Llama_3.2_1B, St...
2026.05
7.8588
GaLore-AW32
Model=Llama_3.2_1B, St...
2026.05
7.9558
AdamW16
Model=Llama_3.2_3B, St...
2026.05
8.1776
AdamW8
Model=Llama_3.2_1B, St...
2026.05
8.2353
GaLore-AF
Model=Llama_3.2_1B, St...
2026.05
8.3177
GaLore-AF
Model=Llama_3.2_3B, St...
2026.05
8.9715
GaLore-AW32
Model=Llama_3.2_3B, St...
2026.05
9.1036
BAOC0.5
Model=Llama_3.2_3B, St...
2026.05
9.5502
AdamW8
Model=Llama_3.2_3B, St...
2026.05
9.6611
Adam-mini
Model=Llama_3.2_3B, St...
2026.05
9.9557
Feedback
Search any
task
Search any
task
