Magicoder
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code-Specific Instruction Tuning Evaluation | Magicoder Evaluation Suite | ARC-C Accuracy54.27 | 48 | |
| Forgetting-aware Instruction Tuning | Magicoder Stability and Plasticity suites (test) | ARC-C54.27 | 36 | |
| Code Generation | Magicoder | Speedup5.86 | 12 | |
| Instruction Tuning | Magicoder HumanEval | Stability50.84 | 7 | |
| LLM Routing | Magicoder (in-distribution) | HV Score0.8514 | 6 | |
| Weight Poisoning Attack | Magicoder | Strict ASR98.38 | 3 | |
| Code Generation | Magicoder | Strict ASR98.38 | 2 |
Showing 7 of 7 rows