Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Instruction Hierarchy Adherence on IHEval Conflict Single-turn
Loading...
52.13
Accuracy
IHDec
13.65
23.64
33.63
43.62
Jun 29, 2026
Accuracy
Updated 25d ago
Evaluation Results
Method
Method
Links
Accuracy
IHDec
Model=Llama-3.1-8B-Ins...
2026.06
52.13
IHDec + Prompting
Model=Qwen3-4B-Instruct
2026.06
51.1
IHDec + ISE
Model=Llama-3.1-8B-Ins...
2026.06
50.4
IHDec + VerIH
Model=Qwen3-8B-Instruct
2026.06
49.3
IHDec + Prompting
Model=Qwen3-8B-Instruct
2026.06
49.1
Prompting
Model=Qwen3-8B-Instruct
2026.06
48.9
VerIH
Model=Qwen3-8B-Instruct
2026.06
47.56
IHDec
Model=Qwen3-4B-Instruct
2026.06
45.7
IHDec
Model=Qwen3-8B-Instruct
2026.06
43.8
Prompting
Model=Qwen3-4B-Instruct
2026.06
39.7
IHDec + Prompting
Model=Llama-3.1-8B-Ins...
2026.06
37.9
Vanilla
Model=Qwen3-4B-Instruct
2026.06
31.3
Vanilla
Model=Qwen3-8B-Instruct
2026.06
27.7
ISE
Model=Llama-3.1-8B-Ins...
2026.06
26.83
Prompting
Model=Llama-3.1-8B-Ins...
2026.06
15.7
Vanilla
Model=Llama-3.1-8B-Ins...
2026.06
15.13
Feedback
Search any
task
Search any
task