Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Code Reasoning on SuperGPQA Code SGPQA-1k (Accuracy, Pass@1)

47.4Accuracy

DFT

3.40814.82926.2537.671Oct 31, 2025
Updated 1mo ago

Evaluation Results

MethodLinks
2025.10
47.447.4
2025.10
45.545.5
2025.10
43.943.9
2025.10
43.143.1
2025.10
42.442.4
2025.10
40.640.6
2025.10
37.937.9
2025.10
37.537.5
2025.10
35.935.9
2025.10
35.935.9
2025.10
35.435.4
2025.10
34.334.3
2025.10
33.433.4
2025.10
32.632.6
2025.10
32.332.3
2025.10
31.831.8
2025.10
31.331.3
2025.10
29.129.1
2025.10
18.618.6
2025.10
15.815.8
2025.10
9.59.5
2025.10
8.58.5
2025.10
6.66.6
2025.10
5.15.1