| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| HumanEval Infilling | LR-DLLM | Pass@1 Single-line81.6 | 12 | 3d ago | |
| HumanEval single-line infilling (test) | code-davinci-002 | Pass Rate87.4 | 12 | 3d ago | |
| HumanEval multi-line code infilling | CM infilling | Pass Rate38.6 | 12 | 3d ago | |
| SantaCoder FIM | Qwen2.5-Coder-7B | EM79.8 | 10 | 3d ago | |
| McEval Multi-line | JavaScript Pass@140 | 10 | 3d ago | ||
| McEval Single-line | LR-DLLM | JavaScript Pass@178.8 | 10 | 3d ago | |
| HumanEval single-line | Qwen2.5-Coder-7B | Pass@192.6 | 10 | 3d ago | |
| HumanEval random span | code-davinci-002 | pass@1 (PSM)74.2 | 6 | 3d ago |
