Share your thoughts, 1 month free Claude Pro on usSee more

LLM Evaluation Performance on FairEval

0.6375Accuracy

CHATEVAL (GPT)

Updated 1mo ago

Evaluation Results

Method	Links
CHATEVAL (GPT) 2026.02		0.6375	0.4587	0.3766	0.3584
MILE-RefHumEval (DeepSeek+Mistral+GPT+Llama+Gemma+Phi+Qwen) 2026.02		0.6375	0.4987	0.3904	0.3742
CHATEVAL (Qwen) 2026.02		0.625	0.4779	0.3462	0.3305
MILE-RefHumEval-Conv (GPT→Mistral→Qwen→Llama→Gemma→Phi→DeepSeek) 2026.02		0.6125	0.4367	0.3251	0.308
MILE-RefHumEval-Conv (DeepSeek→Mistral→GPT→Llama→Gemma→Phi→Qwen) 2026.02		0.5875	0.4284	0.3266	0.3038
MILE-RefHumEval-Conv (Qwen→Mistral→GPT→Llama→Gemma→Phi→DeepSeek) 2026.02		0.5875	0.4249	0.2882	0.2797
MILE-RefHumEval-Conv (Phi→Mistral→GPT→Llama→Gemma→Qwen→DeepSeek) 2026.02		0.5875	0.4242	0.3005	0.2857
CHATEVAL (Gemma) 2026.02		0.575	0.4163	0.2778	0.2663
MILE-RefHumEval-Conv (Gemma→DeepSeek→GPT→Llama→Qwen→Phi→Mistral) 2026.02		0.575	0.41	0.2501	0.2366
CHATEVAL (Phi) 2026.02		0.55	0.4388	0.239	0.2332
MILE-RefHumEval-Conv (Llama→Mistral→GPT→Phi→Gemma→Qwen→DeepSeek) 2026.02		0.5375	0.3845	0.1979	0.1886
CHATEVAL (Deepseek) 2026.02		0.525	0.3916	0.2496	0.2278
CHATEVAL (Llama) 2026.02		0.525	0.3905	0.3106	0.2551
CHATEVAL (Mistral) 2026.02		0.45	0.3326	0.1477	0.1248