Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Code Generation on MBPP (3) (pass@1)

43.6Pass@1

ESPO

34.03236.5163941.484May 28, 2026
Updated 5d ago

Evaluation Results

MethodLinks
2026.05
43.6
2026.05
43.6
2026.05
43.6
2026.05
43.3
2026.05
43.2
2026.05
43.2
2026.05
43
2026.05
42.7
2026.05
42
2026.05
42
2026.05
41.8
2026.05
41.2
2026.05
40.8
2026.05
40.6
2026.05
40.5
2026.05
40.4
2026.05
40.4
2026.05
38.8
2026.05
38.1
2026.05
38
2026.05
38
2026.05
37.2
2026.05
36.6
2026.05
36.5
2026.05
36.5
2026.05
36.2
2026.05
34.8
2026.05
34.4