| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| CanItEdit | Stable-DiffCoder-8B-Instruct | Pass@160 | 17 | 1mo ago | |
| Aider whole format | CodeLlama-7B-Instruct | Average Tries1.5 | 17 | 1mo ago | |
| EditBench Core set | Pass@166.67 | 13 | 1mo ago | ||
| CanItEdit original (test) | Pass@1 (Average)39.9 | 9 | 1mo ago | ||
| Aider-Polyglot | Accuracy61.7 | 6 | 1mo ago |