Our new X account is live! Follow @wizwand_team for updates

Machine Translation on Wikinews-25 it->en

46.8309sacreBLEU

Gemma-9B

Updated 4d ago

Evaluation Results

Method
Gemma-9B 2026.01	46.8309	68.1128	0.4364	2.6548	0.8719	2.9823	0.7406
Gemma-9B 2026.01	46.3719	67.9598	0.4297	2.6547	0.8715	2.9497	0.742
Madlad-7B 2026.01	44.7538	67.3971	0.4161	2.6853	0.8708	2.9593	0.7473
Madlad-7B 2026.01	44.4322	67.5081	0.4206	2.6612	0.8708	2.9019	0.748
Gemma-2B 2026.01	44.1352	66.4546	0.4003	2.8834	0.8668	3.0933	0.7347
NLLB-3.3B 2026.01	44.1242	67.1718	0.4088	2.7849	0.8667	2.9833	0.7385
Gemma-2B 2026.01	43.9921	66.6708	0.4025	2.8107	0.8673	2.9989	0.7139
NLLB-1.3B 2026.01	43.9475	66.8214	0.4001	2.9083	0.8636	3.0729	0.7358
Tower-7B 2026.01	43.9073	66.6963	0.4045	2.7601	0.868	2.9626	0.7412
DIETA_allsynth 2026.01	43.8153	67.3398	0.4161	2.8457	0.8682	3.1184	0.7341
opus-mt-big 2026.01	43.8037	67.0188	0.3969	3.0442	0.8643	3.1695	0.7319
opus-mt-big 2026.01	43.7779	66.9952	0.3961	3.0431	0.8643	3.1643	0.7317
Madlad-3B 2026.01	43.6775	67.0854	0.4017	2.7614	0.8676	2.9197	0.7454
NLLB-3.3B 2026.01	43.6761	66.8444	0.3997	2.8293	0.8658	3.0276	0.7338
DIETA_cont 2026.01	43.1714	66.6126	0.4064	2.8662	0.8654	3.1471	0.7353
NLLB-1.3B 2026.01	42.5641	65.924	0.387	2.9223	0.8614	3.0845	0.7316
Madlad-3B 2026.01	42.4652	66.6616	0.399	2.7922	0.8666	3.0253	0.7428
DIETA 2026.01	41.7966	65.6442	0.3996	2.9451	0.8639	3.0952	0.7321
NLLB-600M 2026.01	41.5714	65.0993	0.36	3.1482	0.8547	3.1991	0.7277
DIETA_nosynth 2026.01	41.5344	65.6032	0.3907	2.9653	0.8621	3.1194	0.7321
DIETA_BT 2026.01	41.4561	64.9263	0.3652	3.2289	0.8565	3.3888	0.7226
NLLB-600M 2026.01	40.5977	64.28	0.3441	3.2964	0.8515	3.3083	0.7244
opus-mt 2026.01	39.4002	64.1805	0.3499	3.3994	0.8533	3.3823	0.7191
opus-mt 2026.01	39.3589	64.2029	0.3523	3.3684	0.8539	3.3569	0.7199
PhiMaestra-3 2026.01	37.8007	62.8038	0.3153	3.2246	0.8508	3.1435	0.7241
Llama-3.1-8B 2026.01	36.9176	59.6155	-0.0196	5.4246	0.8385	5.2481	0.586
mBART 2026.01	35.5482	61.1265	0.3088	3.7333	0.8423	3.529	0.7114
mBART 2026.01	35.5482	61.1265	0.3088	3.7333	0.8423	3.529	0.7114
LLaMAntino-8B 2026.01	34.2716	60.8809	0.2405	3.3702	0.8361	3.3189	0.7117
Cerbero-7B 2026.01	33.4609	58.6011	0.0714	4.4285	0.8306	4.2397	0.6516
ModelloItalia-9B 2026.01	32.7339	61.2928	0.0365	4.7024	0.8133	5.4036	0.6864
EuroLLM-9B 2026.01	32.3876	59.65	0.2791	3.2853	0.8453	3.1678	0.7148
Maestrale-v0.4 2026.01	30.8264	58.1229	0.2349	3.4905	0.8371	3.3525	0.7036
EuroLLM-1.7B 2026.01	27.4118	56.2021	0.0905	4.5263	0.8145	4.0868	0.6674
Minerva-7B 2026.01	25.129	51.4188	-0.2554	7.1825	0.7565	6.9447	0.5386