| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| CodeSearchNet-Java (CSN) CodeXGLUE (test) | CodeT5 (Base) | Smoothed BLEU-420.55 | 38 | 4d ago | |
| CodeXGLUE | CodeT5+ | Java Score20.83 | 38 | 4d ago | |
| Code Summarization dataset | Input Tokens78,246 | 16 | 4d ago | ||
| Python Code Summarization downstream dataset | CompScore57.1 | 14 | 4d ago | ||
| PyT (test) | STAB | ASR84.76 | 12 | 4d ago | |
| CSN (test) | STAB | ASR97.33 | 12 | 4d ago | |
| Py150 (test) | STAB | ASR81.36 | 12 | 4d ago | |
| PyT | Fixed | Recall100 | 12 | 4d ago | |
| CSN | Fixed | Recall100 | 12 | 4d ago | |
| Py150 | Fixed | Recall100 | 12 | 4d ago | |
| CodeXGLUE Code-Text | IRCoder | BLEU-413.21 | 12 | 4d ago | |
| CodeXGLUE Java (test) | REDCODER-EXT | BLEU-422.95 | 11 | 4d ago | |
| CodeXGLUE Python (test) | REDCODER | BLEU-421.01 | 11 | 4d ago | |
| Python GitHub dataset (test) | Hybrid2Seq+Attn+DRL | BLEU-10.2527 | 9 | 4d ago | |
| CodeXGLUE (test) | CodeGeeX | Overall Score20.63 | 7 | 4d ago | |
| TL-CodeSum (TLC) original (test) | PGNN-EK | Smoothed BLEU-451.06 | 6 | 4d ago | |
| CodeXGLUE Python | StarCoder | BLEU21.99 | 4 | 4d ago | |
| Code Summarization (CS) | Vanilla CoT | BLEU20 | 2 | 4d ago |
