Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Natural Language Understanding on EuroEval Italian
Loading...
54.3
EuroEval Score
EuroLLM-9B (Base)
-1.756
12.797
27.35
41.903
May 25, 2026
EuroEval Score
Updated 7d ago
Evaluation Results
Method
Method
Links
EuroEval Score
EuroLLM-9B (Base)
Language model=EuroLLM-9B
2026.05
54.3
aya-3B (Base)
Language model=aya-3B
2026.05
51.6
aya-3B (Multilingual All Lang SFT)
Regime=Multilingual, P...
2026.05
11.3
aya-3B (Monolingual In-lang SFT)
Regime=Monolingual, Po...
2026.05
10.7
aya-3B (Monolingual Max-R SFT)
Regime=Monolingual, Po...
2026.05
10.6
aya-3B (Multilingual Max-R SFT)
Regime=Multilingual, P...
2026.05
10.5
EuroLLM-9B (Multilingual All Lang SFT)
Regime=Multilingual, P...
2026.05
9.9
EuroLLM-9B (Monolingual In-lang SFT)
Regime=Monolingual, Po...
2026.05
7.6
EuroLLM-9B (Multilingual Max-R SFT)
Regime=Multilingual, P...
2026.05
5
EuroLLM-9B (Monolingual Paired DPO)
Regime=Monolingual, Po...
2026.05
3.6
EuroLLM-9B (Multilingual Paired DPO)
Regime=Multilingual, P...
2026.05
1.3
EuroLLM-9B (Monolingual Max-R SFT)
Regime=Monolingual, Po...
2026.05
1.2
aya-3B (Multilingual Paired DPO)
Regime=Multilingual, P...
2026.05
0.6
aya-3B (Monolingual Paired DPO)
Regime=Monolingual, Po...
2026.05
0.4
Feedback
Search any
task
Search any
task