Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Science Question Answering on m-ARC Non-English
Loading...
50.54
Accuracy
Llama 3.1
26.3808
32.6529
38.925
45.1971
Oct 8, 2024
Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
Llama 3.1
Model=Llama 3.1, Param...
2024.10
50.54
Gemma 2
Model=Gemma 2, Paramet...
2024.10
47.79
Gemma 1
Model=Gemma 1, Paramet...
2024.10
42.2
Llama 3.1
Model=Llama 3.1, Param...
2024.10
39.41
Llama 3
Model=Llama 3, Paramet...
2024.10
38.92
Mistral 0.3
Model=Mistral 0.3, Par...
2024.10
36.62
Llama 2
Model=Llama 2, Paramet...
2024.10
31.74
Llama 1
Model=Llama 1, Paramet...
2024.10
29.7
OLMO 1.7
Model=OLMO 1.7, Parame...
2024.10
27.31
Feedback
Search any
task
Search any
task
