Share your thoughts, 1 month free Claude Pro on usSee more

Instruction Following on MulDimIF

84.7Score

HeRL

Updated 3mo ago

Evaluation Results

Method	Links
HeRL 2026.03		84.7
HeRL 2026.03		83.4
HeRL 2026.03		82.5
RLVR 2026.03		79
RLVR 2026.03		77.6
RTT-AON (Ours) 2026.04		76.75
RTT-CSR (Ours) 2026.04		76.33
RL-CSR 2026.04		74.38
RL-AON 2026.04		74.25
RLVR 2026.03		73.5
RTT-AON (Ours) 2026.04		71.83
RTT-CSR (Ours) 2026.04		69.67
RL-AON 2026.04		69.41
RTT-AON (Ours) 2026.04		68.58
SFT 2026.03		67.8
SFT 2026.03		66.9
RL-AON 2026.04		66.83
SFT 2026.03		66.8
RL-CSR 2026.04		66.67
RTT-CSR (Ours) 2026.04		66.33
DPO 2026.03		61.5
Qwen3-4B-Instruct-2507 2026.03		57.3
RL-CSR 2026.04		56.92
DPO 2026.03		56.5
SFT 2026.04		56.5
Qwen3-4B-Instruct† 2026.04		56.08
DPO 2026.04		55.83
DPO 2026.03		54.4
SFT 2026.04		52.83
Qwen2.5-7B-Instruct 2026.03		51.4
Qwen2.5-7B-Instruct† 2026.04		51.08
DPO 2026.04		51.08
SFT 2026.04		36.5
Llama-3.2-3B-Instruct 2026.03		35.8
Llama3.2-3B-Instruct⋆ 2026.04		35.42
DPO 2026.04		34.5