Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Code Generation on MBPP+ (Pass@1, AVG)

75.4Pass@1

CODEBLOCK

52.83258.69164.5570.409Apr 14, 2026Apr 23, 2026May 3, 2026May 12, 2026May 22, 2026May 31, 2026Jun 10, 2026
Updated 1mo ago

Evaluation Results

MethodLinks
2026.06
75.4-
2026.06
74.1-
2026.06
74.1-
2026.06
73.3-
2026.06
73.1-
2026.04
72.884.07
2026.06
72.466
2026.06
71.6-
2026.06
71.4-
2026.04
71.281.75
2026.06
71.164.9
2026.04
70.981.37
2026.06
70.865.1
2026.06
70.663.9
2026.04
70.480.75
2026.06
70.465.5
2026.06
69.862.8
2026.06
69.6-
2026.06
6962.5
2026.06
68.754.5
2026.06
68.554.4
2026.06
6854.6
2026.06
6854.6
2026.06
68-
2026.06
68-
2026.06
67.754.6
2026.06
67.7-
2026.06
67.5-
2026.06
66.951.3
2026.06
66.7-
2026.06
66.67-
2026.06
66.4-
2026.06
66.457.1
2026.06
66.151.8
2026.06
65.87-
2026.06
65.34-
2026.06
65.34-
2026.06
64.81-
2026.06
64.653.6
2026.06
64.653.6
2026.06
64.29-
2026.06
63.554.6
2026.06
63.49-
2026.06
62.7-
2026.06
62.43-
2026.06
62.452.7
2026.06
59.849.4
2026.06
53.749.1
2026.05
-57.94
2026.05
-56.08
2026.05
-55.56
2026.05
-57.14
2026.05
-61.38
2026.05
-60.85
2026.05
-57.94
2026.05
-61.38
2026.05
-59.4
2026.05
-61.15
2026.05
-61.4
2026.05
-61.4
2026.05
-63.16