Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
General Knowledge Evaluation on MMLU Corporate Biology
Loading...
60.4
Accuracy
RMU w/ RNA
23.584
33.142
42.7
52.258
Jan 31, 2025
Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Accuracy
RMU w/ RNA
Model Backbone=Llama-3...
2025.01
60.4
NPO+KL w/ RNA
Model Backbone=Llama-3...
2025.01
55.5
NPO+KL w/ RNA
Model Backbone=Mistral...
2025.01
52
RMU w/ RNA
Model Backbone=Mistral...
2025.01
38.1
RMU
Model Backbone=Llama-3...
2025.01
34.7
NPO+KL
Model Backbone=Mistral...
2025.01
32.6
NPO+KL
Model Backbone=Llama-3...
2025.01
30.5
RMU
Model Backbone=Mistral...
2025.01
25
Feedback
Search any
task
Search any
task