Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

API Invocation Completion on RepoEval 1.0 (test)

50.13Exact Match

GPT-3.5-Turbo

21.072428.616236.1643.7038Mar 22, 2023
Updated 1mo ago

Evaluation Results

MethodLinks
2023.03
50.1374.5
2023.03
49.5674.48
2023.03
49.4474.59
2023.03
49.1974.43
2023.03
47.6973.63
2023.03
40.2567.94
2023.03
39.4466.78
2023.03
39.3165.9
2023.03
39.1365.53
2023.03
38.8865.52
2023.03
38.4464.53
2023.03
38.2564.6
2023.03
37.5664.15
2023.03
36.6964.2
2023.03
35.4463.47
2023.03
34.8863.06
2023.03
34.0663.22
2023.03
33.8861.03
2023.03
33.8161.06
2023.03
33.7560.96
2023.03
31.7559.82
2023.03
26.1956.45
2023.03
25.4456.88
2023.03
22.1952.24