Python
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code Search | Python (test) | Recall@149.4 | 25 | |
| Adversarial Code Compliance | Python (Py) | Decoupling Probability99.4 | 9 | |
| Code Generation | Python deduplicated retrieval codebase (test) | EM1,183 | 9 | |
| Code Comment Generation | Python (test) | BLEU21.01 | 8 | |
| Code Search | Python | MRR85.63 | 5 |
Showing 5 of 5 rows