Code Generation on BigCodeBench Lite-Pro Naive Stream
44.8Accuracy
ReAct
Updated 1d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.06 | 44.8 | - | - | |
2026.06 | 44.8 | - | - | |
2026.06 | 44.5 | 0.3 | - | |
2026.06 | 44.5 | - | 1.4 | |
2026.06 | 43.8 | 1 | - | |
2026.06 | 43.8 | - | 2.1 | |
2026.06 | 43.1 | 1.7 | - | |
2026.06 | 42.4 | - | 2.8 | |
2026.06 | 42.4 | - | 1.4 | |
2026.06 | 41.7 | 3.1 | - | |
2026.06 | 41 | - | 3.5 | |
2026.06 | 39.6 | 5.2 | - | |
2026.06 | 39.6 | - | 4.2 | |
2026.06 | 39.6 | 5.2 | - | |
2026.06 | 39.6 | - | 0 | |
2026.06 | 35.4 | 9.4 | - |