Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Instruction Hierarchy Adherence on IHEval Conflict Multi-turn
Loading...
51.74
Accuracy
VerIH
11.0344
21.6022
32.17
42.7378
Jun 29, 2026
Accuracy
Updated 25d ago
Evaluation Results
Method
Method
Links
Accuracy
VerIH
Model=Qwen3-8B-Instruct
2026.06
51.74
IHDec + VerIH
Model=Qwen3-8B-Instruct
2026.06
51.5
IHDec
Model=Llama-3.1-8B-Ins...
2026.06
50.68
IHDec
Model=Qwen3-8B-Instruct
2026.06
41.85
IHDec + ISE
Model=Llama-3.1-8B-Ins...
2026.06
41.15
IHDec + Prompting
Model=Llama-3.1-8B-Ins...
2026.06
39.85
IHDec + Prompting
Model=Qwen3-4B-Instruct
2026.06
39.1
IHDec + Prompting
Model=Qwen3-8B-Instruct
2026.06
38.85
IHDec
Model=Qwen3-4B-Instruct
2026.06
37.2
Vanilla
Model=Llama-3.1-8B-Ins...
2026.06
31.2
Prompting
Model=Qwen3-4B-Instruct
2026.06
30.3
Prompting
Model=Qwen3-8B-Instruct
2026.06
27.5
Vanilla
Model=Qwen3-8B-Instruct
2026.06
25.8
Vanilla
Model=Qwen3-4B-Instruct
2026.06
23.05
Prompting
Model=Llama-3.1-8B-Ins...
2026.06
13.25
ISE
Model=Llama-3.1-8B-Ins...
2026.06
12.6
Feedback
Search any
task
Search any
task