Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Code Generation on HumanEval-ET

89.6Pass@1

ThinkCoder

22.41639.85857.374.742Dec 20, 2023May 2, 2024Sep 13, 2024Jan 25, 2025Jun 8, 2025Oct 20, 2025Mar 3, 2026
Updated 2mo ago

Evaluation Results

MethodLinks
2024.12
89.6---
2024.12
89.6---
2024.12
89---
2026.03
88.41---
2024.12
87.8---
2023.12
8670--
2024.12
86---
2026.03
86---
2024.12
85.8---
2024.12
84.8---
2024.12
84.8---
2024.12
84.8---
2024.12
84.8---
2026.03
84.1---
2026.03
83.5---
2024.05
82.9---
2024.12
82.9---
2024.12
81.7---
2024.12
81---
2024.12
81---
2024.12
80.5---
2024.12
80.5---
2024.12
80.5---
2026.03
80.5---
2024.12
79.9---
2024.12
79.3---
2024.12
79.3---
2024.05
78.7---
2023.12
77.481.3--
2024.12
77.4---
2026.03
77.4---
2026.03
77.4---
2023.12
76.256.1--
2024.12
76.2---
2024.05
73.8---
2025.02
73.8---
2024.12
73.4---
2025.02
72---
2024.12
71---
2023.12
70.739.7--
2026.03
70.7---
2024.05
70.1---
2024.12
70.1---
2023.12
69.562.8--
2024.03
67.7---
2025.02
67.7---
2024.03
66.9---
2024.03
65.5---
2025.02
65.2---
2025.02
64---
2024.05
62.2---
2024.05
61.6---
2025.02
61.6---
2023.12
57.9106--
2025.02
56.7---
2024.05
56.1---
2023.12
56.131.4--
2025.02
56.1---
2024.03
55.7---
2024.05
55.5---
2023.12
55.551.6--
2023.12
54.928.6--
2026.03
54.9---
2023.12
54.828.3--
2023.12
54.327.2--
2023.12
52.422.7--
2023.12
51.7---
2024.05
50.6---
2023.12
50.6---
2023.12
50.618.5--
2026.03
50.6---
2026.03
50.6---
2025.02
50.6---
2024.05
49.4---
2023.12
49.415.7--
2026.03
49.4---
2024.05
48.8---
2023.12
48.8---
2023.12
48.814.3--
2026.03
48.8---
2024.05
46.2---
2023.12
45.87.3--
2023.12
42.7---
2023.12
42.70--
2026.03
42.7---
2025.02
42.1---
2025.02
42.1---
2025.02
38.4---
2024.05
37.2---
2023.12
37.2-12.9--
2026.03
37.2---
2023.12
36.6---
2025.02
32.9---
2023.12
31.7---
2025.02
31.1---
2023.12
28.1---
2026.03
28.1---
2025.02
26.2---
2023.12
25.6---
2023.12
25---
Showing 100 of 131 rows