RepoBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Long Code Completion | RepoBench >8k | Edit Sim51.24 | 12 | |
| Long Code Completion | RepoBench 4k-8k | Edit Similarity53.3 | 12 | |
| Long Code Completion | RepoBench 0-4k | Edit Similarity52.82 | 12 | |
| Code Completion | RepoBench-P | Similarity0.7305 | 10 | |
| Coding | RepoBench | Pass@125.3 | 6 | |
| code generation | RepoBench P | Score15.04 | 5 |
Showing 6 of 6 rows