Share your thoughts, 1 month free Claude Pro on usSee more

Slack User on IHEval v1 (Conflict)

80Accuracy

Qwen3-4B-it-CoT

Updated 6d ago

Evaluation Results

Method	Links
Qwen3-4B-it-CoT 2026.04		80
Qwen3-4B-it-NS 2026.04		77
Qwen3-4B-it-NSHA-DPO 2026.04		76
Qwen3-4B-it-NSHA-HCAL 2026.04		74.5
Qwen3-4B-it-NSHA-SFT 2026.04		58
Llama3.1-8B-NSHA-HCAL 2026.04		32.5
Llama3.1-8B-NS 2026.04		32
Llama3.1-8B-CoT 2026.04		30
Llama3.1-8B-NSHA-SFT 2026.04		6.5
Qwen3-4B-it 2026.04		1
Llama3.1-8B 2026.04		0
Llama3.1-8B-NSHA-DPO 2026.04		0