Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Reasoning on LiveCodeBench (pass@1 accuracy)

55.45pass@1 Accuracy

Baseline

3.7117.142530.57544.0075Oct 1, 2025Nov 13, 2025Dec 26, 2025Feb 7, 2026Mar 22, 2026May 4, 2026Jun 17, 2026
Updated 1mo ago

Evaluation Results

MethodLinks
2025.10
55.45
2025.10
50.47
2026.06
49.9
2026.06
48.3
2025.10
47.9
2026.06
47.2
2026.06
46.7
2026.06
46.7
2025.10
46.68
2026.06
46.5
2026.06
46.5
2026.06
46.1
2025.10
45.84
2026.06
45.7
2026.06
45.3
2026.06
45.1
2026.06
45.1
2026.06
44.8
2026.06
44.7
2026.06
44.1
2026.06
43.5
2026.06
43.2
2026.06
42.9
2026.06
42.5
2026.06
42.1
2025.10
41.97
2026.06
41.4
2026.06
41.3
2025.10
40.75
2026.06
40.7
2026.06
40.2
2026.06
39.5
2026.06
39.2
2026.06
39
2026.06
38.5
2026.06
38
2026.06
37.9
2026.06
37.7
2026.06
37.1
2026.06
37.1
2026.06
36.8
2026.06
36.4
2026.06
36.4
2026.06
36.2
2026.06
35.8
2026.06
34.9
2025.10
34.56
2026.06
34.5
2026.06
31.1
2026.06
30.8
2026.06
30.4
2026.06
29.5
2026.06
29.4
2026.06
28.4
2026.06
28.2
2026.06
28.1
2026.06
27.6
2026.06
27.6
2026.06
27.2
2026.06
27.2
2026.06
27
2026.06
22.9
2026.06
16.9
2026.06
13.6
2026.06
13.5
2026.06
13.4
2026.06
13
2026.06
12.6
2026.06
12.5
2026.06
11.4
2026.06
5.7