CodeAlpaca
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code generation | CodeAlpaca | Average Speed-up5.67 | 41 | |
| Code Generation | CodeAlpacaPy | Speedup3.23 | 24 | |
| Code Generation | CodeAlpaca 20k | NLL0.597 | 20 | |
| LLM Serving | Evol-CodeAlpaca | p90 Latency (ms/token)234.09 | 12 | |
| Code Generation | CodeAlpaca | Pass@153.66 | 11 | |
| Code Generation | CodeAlpaca | CodeBLEU0.543 | 10 | |
| Code Generation | CodeAlpaca | Score33.2 | 9 | |
| Backdoor Attack | CodeAlpaca-20k (test) | ASR90.5 | 5 | |
| Backdoor Attack | CodeAlpaca 20k code generation instructions | ASR94.8 | 5 | |
| Code Generation | CodeAlpaca code-generation (test) | Perplexity (PPL)4.12 | 5 |
Showing 10 of 10 rows