| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| Cangjie-bench | ILA-agent | ACC90.63 | 12 | 4d ago | |
| DeepFix (test) | BIFI | Accuracy71.7 | 9 | 4d ago | |
| Bugs2Fix (medium) | ERNIE-Code | BLEU-491.2 | 7 | 3d ago | |
| Bugs2Fix (small) | ERNIE-Code | BLEU-480.1 | 7 | 3d ago | |
| Code-Contests (test) | Assistive Decomp | Strict Accuracy12.5 | 4 | 4d ago | |
| APPS (test) | Assistive Decomp | Strict Accuracy21.7 | 4 | 4d ago |
