Our new X account is live! Follow @wizwand_team for updates

Natural Language Generation on PTB-XL (test)

0.539BLEU-1

LLaMA-3-Instruct

Updated 4d ago

Evaluation Results

Method	Links
LLaMA-3-Instruct 2024.03		0.539	0.513	0.494	0.467	0.698	0.615	0.725	0.646	4.45
LLaMA-2-Instruct 2024.03		0.515	0.484	0.469	0.439	0.675	0.594	0.698	0.624	4.05
LLaMA-1 2024.03		0.514	0.485	0.465	0.43	0.678	0.588	0.682	0.613	3.97
OPT 2024.03		0.502	0.477	0.431	0.418	0.662	0.568	0.669	0.624	3.94
Mistral-Instruct 2024.03		0.501	0.481	0.457	0.425	0.664	0.592	0.7	0.641	4.01
BLOOM 2024.03		0.491	0.462	0.427	0.415	0.665	0.58	0.678	0.605	3.8
Mistral 2024.03		0.486	0.475	0.446	0.421	0.673	0.591	0.697	0.634	3.98
GPT-J 2024.03		0.485	0.452	0.428	0.405	0.656	0.55	0.662	0.613	3.72
GPT-Neo 2024.03		0.474	0.449	0.398	0.373	0.602	0.486	0.674	0.595	3.7
GPT-NeoX 2024.03		0.469	0.453	0.417	0.399	0.62	0.553	0.688	0.622	3.58
GPT2-Large 2024.03		0.437	0.395	0.355	0.32	0.575	0.481	0.652	0.527	3.25
GPT2-Medium 2024.03		0.329	0.278	0.254	0.232	0.441	0.391	0.561	0.433	2.12