Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Code Reasoning on CRUX official (test)

51.1Pass@1 Accuracy

Qwen2.5-7B-FULL

13.1422.99532.8542.705Jun 13, 2025
Updated 1mo ago

Evaluation Results

MethodLinks
2025.06
51.1
2025.06
44
2025.06
43.3
2025.06
42.5
2025.06
41.5
2025.06
40.8
2025.06
39.9
2025.06
38.1
2025.06
34.9
2025.06
25.1
2025.06
24.3
2025.06
21
2025.06
18.1
2025.06
17.8
2025.06
17.4
2025.06
16.5
2025.06
16.1
2025.06
15.4
2025.06
15.3
2025.06
14.6