| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Commonsense Question Answering | CosQA (test) | Accuracy82 | 18 | |
| Code Retrieval | COSQA Code | NDCG@1032.05 | 8 | |
| Text-to-Code Retrieval | CosQA CodeXGLUE | MRR74 | 8 | |
| NL2Code Search | CoSQA (test) | MRR55.77 | 7 | |
| Code Search | CoSQA 1.0 (test) | MRR64.66 | 4 | |
| Code Question Answering | CoSQA 1.0 (test) | Accuracy63.38 | 4 |