Python
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Graphical API Recommendation | Python 13 | mAP83.4 | 56 | |
| Code Search | Python (test) | Recall@149.4 | 25 | |
| Code Summarization Factual Consistency | Python | Pearson Correlation (rp)0.497 | 15 | |
| Adversarial Code Compliance | Python (Py) | Decoupling Probability99.4 | 9 | |
| Code Generation | Python deduplicated retrieval codebase (test) | EM1,183 | 9 | |
| Code Comment Generation | Python (test) | BLEU21.01 | 8 | |
| Code Search | Python | MRR85.63 | 5 | |
| RRT-Connect Planning | Python 2D | Wall-Clock Time (ms)4.4 | 2 |
Showing 8 of 8 rows