Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Cross-file code completion on CrossCodeEval Python (test)

78.78Code ES

DeepSeekCoder

69.097671.611374.12576.6387Feb 29, 2024
Updated 1mo ago

Evaluation Results

MethodLinks
2024.02
78.7874.51
2024.02
78.7274.27
2024.02
77.4373.16
2024.02
76.3471.36
2024.02
7670.75
2024.02
75.8870.97
2024.02
74.5269.11
2024.02
74.5268.81
2024.02
73.4366.74
2024.02
73.0167.85
2024.02
72.4166.76
2024.02
72.2465.4
2024.02
69.4762.56