CodeAlpaca
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code generation | CodeAlpaca | Average Speed-up5.67 | 41 | |
| Code Generation | CodeAlpacaPy | Speedup3.23 | 24 | |
| Code Generation | CodeAlpaca 20k | NLL0.597 | 20 | |
| Code Generation | CodeAlpaca | Score33.2 | 9 | |
| Backdoor Attack | CodeAlpaca-20k (test) | ASR90.5 | 5 | |
| Backdoor Attack | CodeAlpaca 20k code generation instructions | ASR94.8 | 5 | |
| Code Generation | CodeAlpaca code-generation (test) | Perplexity (PPL)4.12 | 5 |
Showing 7 of 7 rows