Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Multiple-choice Question Answering on m-MMLU Non-English
Loading...
63.84
Accuracy
Llama 3.1
26.6392
36.2971
45.955
55.6129
Oct 8, 2024
Accuracy
Updated 3mo ago
Evaluation Results
Method
Method
Links
Accuracy
Llama 3.1
Model=Llama 3.1, Param...
2024.10
63.84
Gemma 2
Model=Gemma 2, Paramet...
2024.10
55.82
Gemma 1
Model=Gemma 1, Paramet...
2024.10
47.34
Llama 3.1
Model=Llama 3.1, Param...
2024.10
47.2
Llama 3
Model=Llama 3, Paramet...
2024.10
46.64
Mistral 0.3
Model=Mistral 0.3, Par...
2024.10
42.07
OLMO 1.7
Model=OLMO 1.7, Parame...
2024.10
33.9
Llama 2
Model=Llama 2, Paramet...
2024.10
32.6
Llama 1
Model=Llama 1, Paramet...
2024.10
28.07
Feedback
Search any
task
Search any
task
