OpenAPI completion on OpenAPI completion benchmark
45Correctness (Max)
Code Llama 7B
Updated 5mo ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2024.05 | 45 | 84 | 32 | 63.1 | |
2024.05 | 42 | 79 | 26.8 | 57.1 | |
2024.05 | 42 | 76 | 34 | 69.1 | |
2024.05 | 36 | 64 | 31.1 | 60.7 | |
2024.05 | 34 | 68 | 30.2 | 64 | |
2024.05 | 29 | 68 | 29 | 68 |