Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Code Generation on CodeEval-Pro BigCodeBench-Lite-Pro and HumanEval-Pro (2nd Pass)

64.6Average Accuracy

MEMPROBE

37.14444.27251.458.528Jun 1, 2026
Updated 1mo ago

Evaluation Results

MethodLinks
2026.06
64.6
2026.06
62.5
2026.06
60.4
2026.06
59
2026.06
56.3
2026.06
50.7
2026.06
45.8
2026.06
44.8
2026.06
44.8
2026.06
44.5
2026.06
44.4
2026.06
43.8
2026.06
42.4
2026.06
42.4
2026.06
41
2026.06
39.6
2026.06
39.6
2026.06
38.2