Share your thoughts, 1 month free Claude Pro on usSee more

Binary Outcome Discrimination on Resolved vs. Rest (test)

90.1AUC

Qwen2.5-Coder-7B

Updated 1mo ago

Evaluation Results

Method	Links
Qwen2.5-Coder-7B 2026.06		90.1	79.4
Qwen2.5-Coder-14B 2026.06		88.3	82.7
Qwen3-4B-Base 2026.06		88.2	74.8
Qwen3-8B-Base 2026.06		87.7	79.5
Qwen2.5-Coder-1.5B 2026.06		87.5	57.7
CodeLlama-7B 2026.06		87.5	58.6
Qwen2.5-7B 2026.06		86.6	67.3
Qwen2.5-Coder-3B 2026.06		86.3	70.2
Qwen3-1.7B-Base 2026.06		86.3	61.3
Qwen2.5-1.5B 2026.06		86.2	55.7
All 2026.06		85	61.9
Qwen2.5-Coder-0.5B 2026.06		84.7	46.4
DeepSeek-Coder-6.7B 2026.06		84.1	71.2
Llama-2-7B 2026.06		83.8	50.4
Qwen3-0.6B-Base 2026.06		80.8	52.2
Qwen2.5-0.5B 2026.06		77.1	45
Qwen2.5-3B 2026.06		76.4	55.3