API Invocation Completion on RepoEval 1.0 (test)
50.13Exact Match
GPT-3.5-Turbo
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2023.03 | 50.13 | 74.5 | |
2023.03 | 49.56 | 74.48 | |
2023.03 | 49.44 | 74.59 | |
2023.03 | 49.19 | 74.43 | |
2023.03 | 47.69 | 73.63 | |
2023.03 | 40.25 | 67.94 | |
2023.03 | 39.44 | 66.78 | |
2023.03 | 39.31 | 65.9 | |
2023.03 | 39.13 | 65.53 | |
2023.03 | 38.88 | 65.52 | |
2023.03 | 38.44 | 64.53 | |
2023.03 | 38.25 | 64.6 | |
2023.03 | 37.56 | 64.15 | |
2023.03 | 36.69 | 64.2 | |
2023.03 | 35.44 | 63.47 | |
2023.03 | 34.88 | 63.06 | |
2023.03 | 34.06 | 63.22 | |
2023.03 | 33.88 | 61.03 | |
2023.03 | 33.81 | 61.06 | |
2023.03 | 33.75 | 60.96 | |
2023.03 | 31.75 | 59.82 | |
2023.03 | 26.19 | 56.45 | |
2023.03 | 25.44 | 56.88 | |
2023.03 | 22.19 | 52.24 |