Share your thoughts, 1 month free Claude Pro on usSee more

Semantic Similarity on ICEWS18 (test)

40.39BLEU-4

Llama3-8B-Instruct

Updated 1mo ago

Evaluation Results

Method	Links
Llama3-8B-Instruct 2025.05		40.39	52.12	54.85	84.6
Mistral-7B-Instruct 2025.05		39.64	51.62	54.04	84.37
Qwen2.5-7B-Instruct 2025.05		38.99	50.7	53.79	84.17
Qwen2.5-7B-Instruct 2025.05		37.49	49.61	52.07	83.6
Llama3-8B-Instruct 2025.05		37.33	49.18	53.05	83.58
Mistral-7B-Instruct 2025.05		36.96	49.12	51.7	83.38
Qwen2.5-7B-Instruct 2025.05		25.5	37.61	42.91	78.56
Mistral-7B-Instruct 2025.05		25.46	37.62	42.91	78.67
Llama3-8B-Instruct 2025.05		23.55	35.95	42.54	78.02
GPT-4o 2025.05		14.84	31.16	37.47	72.98
Qwen2.5-7B-Instruct 2025.05		10.46	27.97	26.8	71.77
Llama3-8B-Instruct 2025.05		10.01	29.52	27.19	70.01
Mistral-7B-Instruct 2025.05		9.74	29	26	71.95
GPT-4o 2025.05		9.33	22.67	29.87	67.48
Mistral-7B-Instruct 2025.05		7.6	19.43	23.98	65.87
Qwen2.5-7B-Instruct 2025.05		7.02	19.52	30.09	65.92
Llama3-8B-Instruct 2025.05		4.1	15.85	16.2	61.14