Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Multiple-choice Question Answering on m-MMLU English
Loading...
77
Accuracy
Llama 3.1
34.0376
45.1913
56.345
67.4987
Oct 8, 2024
Accuracy
Updated 3mo ago
Evaluation Results
Method
Method
Links
Accuracy
Llama 3.1
Model=Llama 3.1, Param...
2024.10
77
Gemma 2
Model=Gemma 2, Paramet...
2024.10
69.98
Llama 3.1
Model=Llama 3.1, Param...
2024.10
63.15
Llama 3
Model=Llama 3, Paramet...
2024.10
62.94
Gemma 1
Model=Gemma 1, Paramet...
2024.10
61.38
Mistral 0.3
Model=Mistral 0.3, Par...
2024.10
59.88
OLMO 1.7
Model=OLMO 1.7, Parame...
2024.10
52.1
Llama 2
Model=Llama 2, Paramet...
2024.10
45.23
Llama 1
Model=Llama 1, Paramet...
2024.10
35.69
Feedback
Search any
task
Search any
task
