Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Code Generation on HumanEval (Speed/Throughput)

287.77Tokens/s

PRISM

-8.494868.4201145.335222.2499Nov 16, 2024Jan 28, 2025Apr 12, 2025Jun 25, 2025Sep 7, 2025Nov 20, 2025Feb 2, 2026
Updated 3d ago

Evaluation Results

MethodLinks
2026.02
287.77--5.26-
2026.02
271.59--5.12-
2026.02
252.18--5.44-
2026.02
251.94--4.75-
2026.02
250.55--4.88-
2026.02
233.54--4.74-
2026.02
230.42--5.16-
2026.02
218.69--4.48-
2026.02
198.19--4.57-
2026.02
182.53--5.08-
2026.02
171.76--5.93-
2026.02
169.27--4.75-
2026.02
154.91--4.35-
2026.02
154.6--5.36-
2026.02
133.32--2.72-
2026.02
129.76--2.62-
2026.02
103.57----
2026.02
103.27----
2026.01
93.30.4345.1--
2026.02
91.51----
2024.11
91.54.762.54--
2026.02
91.02----
2024.11
85.584.742.37--
2024.11
78.965.123.54--
2024.11
78.042.772.16--
2024.11
77.855.153.49--
2026.01
75.80.4456.4--
2026.01
71.50.4333.9--
2024.11
71.492.931.99--
2024.11
64.382.061.79--
2026.01
520.4454.4--
2024.11
50.872.792.28--
2026.01
50.2-2.67-4.89
2024.11
48.922.422.2--
2024.11
46.032.792.07--
2026.01
44.89-2.39-3.48
2024.11
42.391.31.18--
2026.01
34.10.395.3--
2024.11
32.061.541.44--
2026.01
30.60.4271.7--
2024.11
29.563.613.14--
2024.11
28.183.533--
2026.01
26.70.4029.2--
2024.11
22.442.732.39--
2026.01
21.80.4571.8--
2024.11
19.642.642.09--
2026.01
19.10.3723--
2024.11
19.082.052.03--
2026.01
18.90.3961--
2026.01
18.8----
2026.01
18.40.4151--
2026.01
14.30.4511.2--
2024.11
14.181.581.51--
2026.01
13.60.3984.7--
2026.01
11.90.4391--
2026.01
10.90.3841.7--
2026.01
6.60.4021--
2026.01
6.40.4391--
2026.01
4.80.3781.7--
2026.01
3.30.4021.1--
2026.01
2.90.4051--