Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Code Generation on MBPP (pass@1, Improvement Rate (%))

91.8Pass@1

AgentCoder

31.06446.83262.678.368Dec 20, 2023Apr 29, 2024Sep 7, 2024Jan 16, 2025May 27, 2025Oct 5, 2025Feb 13, 2026
Updated 4d ago

Evaluation Results

MethodLinks
2023.12
91.834.4
2023.12
91.444.2
2023.12
89.972.2
2023.12
89.571.5
2023.12
87.728.4
2023.12
80.618
2023.12
79.812.9
2023.12
78.915.5
2023.12
78.9-
2023.12
78.7-
2025.12
78.3-
2023.12
77.112.9
2023.12
76.3183.6
2023.12
75.9135
2025.12
75.1-
2026.02
73.57-
2023.12
73.57.6
2025.12
73.5-
2025.12
72.5-
2023.12
72.4-
2023.12
71.436.8
2025.12
70.6-
2023.12
70.4-
2023.12
7034.1
2026.02
69.81-
2023.12
69.833.7
2023.12
69.3-
2025.12
69.3-
2023.12
69.2-
2025.12
69.2-
2023.12
68.4-
2023.12
68.3-
2023.12
68.230.7
2023.12
67.7-
2023.12
6728.4
2023.12
65.826.1
2023.12
65.826.1
2025.12
65.8-
2025.12
65.6-
2025.12
65.1-
2026.02
64.9-
2025.12
64-
2025.12
63.9-
2025.12
63.7-
2023.12
63.4-
2025.12
61.7-
2025.12
60.8-
2023.12
60.115.1
2025.12
58.7-
2023.12
58.612.3
2025.12
58.4-
2025.12
58.4-
2023.12
58.1-
2025.12
57.7-
2023.12
56.48
2025.12
56.1-
2026.02
54.12-
2026.02
53.23-
2023.12
52.2-
2026.02
50.58-
2023.12
46.1-11.7
2025.12
44.6-
2023.12
43.6-
2025.12
43.4-
2025.12
43-
2025.12
43-
2026.01
42.59-
2026.01
42.59-
2025.12
42.4-
2026.01
42.33-
2026.01
42.06-
2025.12
42-
2025.12
41.8-
2026.01
41.53-
2025.12
41.4-
2025.12
41.2-
2025.12
40.8-
2025.12
40.6-
2026.01
40.48-
2025.12
39.9-
2025.12
39.9-
2025.12
39-
2025.12
38.8-
2025.12
38.7-
2023.12
38.6-
2026.01
37.3-
2025.12
37-
2026.01
36.51-
2025.12
36.4-
2025.12
36-
2026.01
35.72-
2025.12
35.6-
2026.01
35.47-
2025.12
35.2-
2025.12
34.8-
2025.12
34.6-
2025.12
34.4-
2025.12
34.2-
2025.12
33.5-
2025.12
33.4-
Showing 100 of 113 rows