Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Knowledge Retention on MMLU (full)
Loading...
58
MMLU Accuracy
Original
25.656
34.053
42.45
50.847
Oct 22, 2025
Nov 12, 2025
Dec 4, 2025
Dec 26, 2025
Jan 17, 2026
Feb 8, 2026
Mar 2, 2026
MMLU Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
MMLU Accuracy
Original
Backbone=Zephyr-7B-β
2025.10
58
RMU
Backbone=Zephyr-7B-β
2025.10
55
BS-S
Backbone=Zephyr-7B-β
2025.10
54
BS-T
Backbone=Zephyr-7B-β
2025.10
52
WGA
Backbone=Zephyr-7B-β
2025.10
48
Retain
Base Model=Llama-2-7B
2026.03
47.8
Original
Base Model=Llama-2-7B
2026.03
46.3
Fine-tune
Base Model=Llama-2-7B
2026.03
46
ELM
Base Model=Llama-2-7B
2026.03
44.6
Ours
Base Model=Llama-2-7B
2026.03
44.6
WHP
Base Model=Llama-2-7B
2026.03
44.4
NPO
Backbone=Zephyr-7B-β
2025.10
44
SimNPO
Backbone=Zephyr-7B-β
2025.10
44
A-LoRA
Base Model=Llama-2-7B
2026.03
43.8
GD
Base Model=Llama-2-7B
2026.03
43.6
GradDiff
Backbone=Zephyr-7B-β
2025.10
43
NPO
Base Model=Llama-2-7B
2026.03
42.7
KL
Base Model=Llama-2-7B
2026.03
41.1
LoRA
Base Model=Llama-2-7B
2026.03
38.9
GA
Base Model=Llama-2-7B
2026.03
26.9
Feedback
Search any
task
Search any
task