Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Functional Correctness on HumanEval (p@k and Precision)

71.57Pass@1

Dense

1.505219.695137.88556.0749Jun 4, 2026
Updated 1mo ago

Evaluation Results

MethodLinks
2026.06
71.5785.5889.63100
2026.06
54.7973.1884.2185.3
2026.06
46.4362.0870.3472
2026.06
41.9560.7878.6572.5
2026.06
38.1657.3875.1468.1
2026.06
36.768.387.8100
2026.06
34.3753.9871.6363.7
2026.06
27.6760.0483.53100
2026.06
26.253.578.0479.5
2026.06
21.3746.9172.2580.6
2026.06
21.338.5751.0543.9
2026.06
18.9435.9358.3956.9
2026.06
18.734.7147.2939.8
2026.06
16.130.8543.5335.7
2026.06
15.3231.5853.6849.7
2026.06
15.0633.7860.9761.2
2026.06
14.9633.0749.8556.3
2026.06
14.1630.0942.443.6
2026.06
11.9127.7255.3351.8
2026.06
11.727.2348.9742.5
2026.06
10.5520.7733.132.3
2026.06
8.7520.6549.6941.8
2026.06
7.9820.537.1935.8
2026.06
7.915.0423.823.6
2026.06
5.9614.7329.8827.3
2026.06
5.81017.616.8
2026.06
4.29.723.8520