Share your thoughts, 1 month free Claude Pro on usSee more

Natural Language Understanding on EuroEval French

52.2EuroEval Score

EuroLLM-9B (Base)

Updated 1mo ago

Evaluation Results

Method	Links
EuroLLM-9B (Base) 2026.05		52.2
aya-3B (Base) 2026.05		45.9
ICR (8B) 2026.05		9.9
MAPO (13B) 2026.05		7.4
aya-3B (Multilingual All Lang SFT) 2026.05		7.2
aya-3B (Multilingual Max-R SFT) 2026.05		7.2
aya-3B (Monolingual Max-R SFT) 2026.05		6.8
EuroLLM-9B (Multilingual All Lang SFT) 2026.05		6.6
aya-3B (Monolingual In-lang SFT) 2026.05		5.2
ICR (8B) 2026.05		3.6
EuroLLM-9B (Multilingual Max-R SFT) 2026.05		2.7
EuroLLM-9B (Monolingual In-lang SFT) 2026.05		2
EuroLLM-9B (Monolingual Max-R SFT) 2026.05		1.3
MAPO (13B) 2026.05		1.1
EuroLLM-9B (Multilingual Paired DPO) 2026.05		0.8
EuroLLM-9B (Monolingual Paired DPO) 2026.05		0.6
aya-3B (Multilingual Paired DPO) 2026.05		0.3
aya-3B (Monolingual Paired DPO) 2026.05		0.1