Codeforces
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Competitive Programming | CodeForces | Overall Score78.3 | 32 | |
| Competitive Programming | Codeforces 2501 - 2507 | ELO2,590 | 32 | |
| Code Generation | CodeForces (test) | Sig. Score15.3 | 26 | |
| Knowledge Tracing | Codeforces | AUC0.701 | 24 | |
| Code Generation | CodeForces | Avg@824.89 | 22 | |
| Code Generation | Codeforces (CF) | CF Score20.46 | 21 | |
| Competitive Coding | CodeForces | Best@849.9 | 16 | |
| Competitive Programming | Codeforces | Average Score @856.1 | 14 | |
| Coding | Codeforces (CF) | CF Score10.52 | 14 | |
| Code Generation | CodeForces | pass@153.79 | 14 | |
| Code Reasoning | CodeForces | Rating1,533.64 | 12 | |
| Code generation | CodeForces | Pass@111 | 10 | |
| Coding | CodeForces | Pass Rate25.51 | 9 | |
| Competitive Programming | Codeforces (val) | Pass@174.33 | 6 | |
| Coding Reasoning | Codeforces | Pass Rate71.2 | 5 | |
| Code Generation | Codeforces | Accuracy13.8 | 4 | |
| Competitive Code Generation | Codeforces 10 competitions from 2021/12/01 to 2021/12/28 | Score (Problem 1591)74.5 | 3 | |
| Code Generation | Codeforces | Pass@k45.97 | 2 |
Showing 18 of 18 rows