Share your thoughts, 1 month free Claude Pro on usSee more

Get Webpage on IHEval v1 (Conflict)

39.8Accuracy

Qwen3-4B-it-CoT

Updated 6d ago

Evaluation Results

Method	Links
Qwen3-4B-it-CoT 2026.04		39.8
Qwen3-4B-it-NSHA-DPO 2026.04		36.9
Qwen3-4B-it-NSHA-HCAL 2026.04		36.3
Qwen3-4B-it-NS 2026.04		36.2
Qwen3-4B-it-NSHA-SFT 2026.04		31.6
Llama3.1-8B-NS 2026.04		12.7
Llama3.1-8B-NSHA-HCAL 2026.04		11.5
Llama3.1-8B-CoT 2026.04		9.2
Llama3.1-8B 2026.04		7.8
Llama3.1-8B-NSHA-DPO 2026.04		5
Llama3.1-8B-NSHA-SFT 2026.04		4.1
Qwen3-4B-it 2026.04		1.9