Long-context language generation on RepoBench-P
4.46Average Acceptance Length
LongSpec
Updated 11d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2025.02 | 4.46 | 96.96 | 3.26 | |
2025.02 | 4.03 | 115.27 | 2.7 | |
2025.02 | 3.86 | 110.76 | 2.38 | |
2025.02 | 3.59 | 77.22 | 2.65 | |
2025.02 | 3.39 | 91.28 | 1.69 | |
2025.02 | 2.94 | 36.66 | 1.26 | |
2025.02 | 2.85 | 35.67 | 1.2 | |
2025.02 | 2.71 | 89.22 | 2.09 | |
2025.02 | 2.61 | 44.39 | 0.82 | |
2025.02 | 2.57 | 48.75 | 1.05 | |
2025.02 | 2.57 | 44.13 | 1.03 | |
2025.02 | 2.23 | 74.15 | 1.59 | |
2025.02 | 1.8 | 41.07 | 1.38 | |
2025.02 | 1.38 | 45.7 | 0.85 | |
2025.02 | 1.32 | 30.6 | 1.05 | |
2025.02 | 1 | 19.18 | - | |
2025.02 | 1 | 46.61 | 1 | |
2025.02 | 1 | 13.44 | - | |
2025.02 | 1 | 29.14 | 1 | |
2025.02 | 1 | 17.02 | - | |
2025.02 | 1 | 42.69 | 1 | |
2025.02 | 1 | 13.85 | - | |
2025.02 | 1 | 29.74 | 1 | |
2025.02 | 1 | 22.77 | - | |
2025.02 | 1 | 54.08 | 1 |