Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Code Generation on MBPP+ (Accuracy, TPS, Speedup)

170.9TPS (tok/s)

PARSE + EAGLE3

61.07689.588118.1146.612May 5, 2026
Updated 7d ago

Evaluation Results

MethodLinks
2026.05
170.9-1.97-
2026.05
152.6-1.76-
2026.05
148.174.61.7-
2026.05
110.873.81.7-
2026.05
86.979.9--
2026.05
65.378--
2026.05
-66.9--
2026.05
-69.3--
2026.05
---0.5423
2026.05
---0.7778
2026.05
---0.7857