Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Knowledge Retention on Llama 8B Pretraining Distribution 3.1
Loading...
12.3
Retain (pp)
LoRA
4.604
6.602
8.6
10.598
Apr 20, 2026
Retain (pp)
Updated 1mo ago
Evaluation Results
Method
Method
Links
Retain (pp)
LoRA
Backbone=Llama-3.1-8B,...
2026.04
12.3
Proj-LoRA
Backbone=Llama-3.1-8B,...
2026.04
8.9
PiSSA
Backbone=Llama-3.1-8B,...
2026.04
7.1
HiP-LoRA
Backbone=Llama-3.1-8B,...
2026.04
4.9
Feedback
Search any
task
Search any
task
