Code Generation on LiveCodeBench v6 (Accuracy, Mean, Drop)
59.06Accuracy
BF16
Updated 14d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.05 | 59.06 | 74.19 | - | |
2026.05 | 58.48 | 78.15 | 0.26 | |
2026.05 | 56.02 | 74.43 | 0.24 | |
2026.05 | 55.56 | 71.99 | -2.2 | |
2026.05 | 53.57 | 74.17 | -0.02 | |
2026.05 | 52.63 | 78.16 | 0.27 | |
2026.05 | 50.49 | 77.95 | 0.06 | |
2026.05 | 49.12 | 77.89 | - | |
2026.05 | 49.01 | 70.84 | - | |
2026.05 | 48.66 | 75.64 | - | |
2026.05 | 48.54 | 75.14 | -2.75 | |
2026.05 | 47.95 | 69.97 | -0.87 | |
2026.05 | 46.32 | 69.416 | -1.42 | |
2026.05 | 46.2 | 73.11 | -2.53 | |
2026.05 | 45.38 | 71.864 | -3.78 | |
2026.05 | 37.03 | 60.49 | -17.4 | |
2026.05 | 21.05 | 56.88 | -13.96 | |
2026.05 | 0.58 | 31.74 | -43.9 | |
2026.05 | 0.58 | 10.14 | -60.7 | |
2026.05 | 0.39 | 7.9 | -66.29 | |
2026.05 | 0 | 1.4 | -74.24 | |
2026.05 | 0 | 0 | -75.64 | |
2026.05 | 0 | 0 | -70.84 | |
2026.05 | 0 | 0 | -74.19 |