Code Generation on BigCodeBench (Accuracy, Average Added Skill Tokens)
52.19Accuracy
Full Text
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.06 | 52.19 | 4,628 | |
2026.06 | 50.35 | 1,889 | |
2026.06 | 49.3 | 4,676 | |
2026.06 | 49.3 | 3,316 | |
2026.06 | 49.12 | 1,414 | |
2026.06 | 47.46 | 2,615 | |
2026.06 | 46.93 | 3,172 | |
2026.06 | 46.58 | 708 | |
2026.06 | 46.05 | 3,362 | |
2026.06 | 45.53 | 1,414 | |
2026.06 | 45.26 | 1,284 | |
2026.06 | 44.21 | 708 | |
2026.06 | 43.77 | 0 | |
2026.06 | 43.6 | 2,655 | |
2026.06 | 40.96 | 0 | |
2026.06 | 40.7 | 1,300 | |
2026.06 | 29.47 | 256 | |
2026.06 | 0.88 | 256 | |
2026.06 | 0.18 | 256 | |
2026.06 | 0.09 | 256 |