CSN-Python
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Retrieval-Augmented Code Generation | CSN-Python Non-target Queries (test) | Similarity (GPT-4o)0.318 | 19 | |
| Retrieval-Augmented Code Generation | CSN-Python Target Queries (test) | Verification Rate (GPT-4o)41.44 | 19 | |
| Code Retrieval | CSN-Python Non-target Queries (test) | MRR0.669 | 19 | |
| Code Retrieval | CSN-Python Target Queries (test) | ASR@117.64 | 18 |
Showing 4 of 4 rows