Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Code Generation on MBPP (Pass@1, Pass@10, Pass@100)

80.4Pass@1

Ouro 2.6B

3.23223.26643.363.334Feb 18, 2025Apr 26, 2025Jul 3, 2025Sep 9, 2025Nov 16, 2025Jan 23, 2026Apr 1, 2026
Updated 16d ago

Evaluation Results

MethodLinks
2025.10
80.4---
2025.10
79.9---
2026.04
78.4--91.6
2026.04
77.6--93.8
2025.10
75.1---
2026.04
70.7--83.4
2025.10
68.7---
2025.10
66.8---
2025.10
65.6---
2025.10
64.2---
2025.10
63.2---
2025.10
61.6---
2026.04
58.9--76.5
2025.09
55.456.2--
2025.10
50.1---
2026.04
48.4--64.5
2026.04
46.9--77.8
2026.04
45.1--71.6
2026.04
44.4--75.1
2025.09
38.853.4--
2026.04
27.9--68.5
2025.09
25.645.4--
2025.02
23.142.662-
2025.02
22.34163.7-
2025.02
18.935.852.4-
2025.02
18.234.550.7-
2025.02
17.632.651.9-
2025.09
17.632.6--
2025.09
16.738.4--
2025.02
16.430.852.4-
2025.02
15.729.243.1-
2025.02
15.226.339.5-
2025.02
12.823.835-
2025.02
12.824.545.2-
2025.09
1036.4--
2025.09
9.433.4--
2025.02
9.319.736.4-
2025.02
8.517.238.6-
2025.02
7.115.524.6-
2025.02
6.211.821.5-
2025.09
6.225--