Share your thoughts, 1 month free Claude Pro on usSee more

Plain Summarization on BigPatent

44.94ROUGE-1

Llama-3.1-8B-Instruct

Updated 5d ago

Evaluation Results

Method	Links
Llama-3.1-8B-Instruct 2026.04		44.94	86.68	21.13	13.36	16.45	55.28	54.73
GPT-4o 2026.04		41.87	86.52	18.6	13.76	18.32	59.62	53.19
Llama-3.1-8B-Instruct 2026.04		40.09	85.73	16.88	12.14	13.76	61.08	57.95
GPT-4o 2026.04		37.74	85.82	12.57	12.31	14.69	70.51	69.53
Llama-3.1-8B-Instruct 2026.04		36.87	85.11	14.62	11.47	12.42	62.62	58.94
GPT-4o 2026.04		35.4	85.44	10.27	11.7	12.84	74.44	73.49
Qwen3-8B 2026.04		34.21	85.55	20.88	15.1	21.52	55.86	42.87
Qwen3-8B 2026.04		30.55	84.89	14.48	13.32	16.29	69.34	49.87
Qwen3-8B 2026.04		29.18	84.5	12.38	12.74	14.71	71.56	54.58