Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Code Completion on CrossCodeEval Project-level (test)
Loading...
9.08
C-EM
CoCoGen
1.6232
3.5591
5.495
7.4309
Mar 25, 2024
C-EM
C-ES
I-EM
I-F1
Updated 4d ago
Evaluation Results
Method
Method
Links
C-EM
C-ES
I-EM
I-F1
CoCoGen
Base Model=GPT-3.5-Turbo
2024.03
9.08
55.31
14.11
42.34
RepoCoder
Base Model=GPT-3.5-Turbo
2024.03
8.52
55.05
13.02
41.05
ReAcc
Base Model=GPT-3.5-Turbo
2024.03
5.48
54.03
10.02
38.49
Direct
Base Model=GPT-3.5-Turbo
2024.03
1.91
50.51
3.6
32.27
Feedback
Search any
task
Search any
task
