Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Line-level code completion on JavaCorpus
Loading...
37.9
EM
CodeT5+
24.276
27.813
31.35
34.887
May 13, 2023
EM
Edit Sim
Updated 6d ago
Evaluation Results
Method
Method
Links
EM
Edit Sim
CodeT5+
Parameters=770M, Mode=...
2023.05
37.9
72.25
CodeGen-multi
Parameters=350M, Mode=...
2023.05
35.47
69.22
CodeT5+
Parameters=220M, Mode=...
2023.05
35.17
69.48
UniXcoder
Parameters=125M, Mode=...
2023.05
32.9
65.78
CodeGPT
Parameters=124M, Mode=...
2023.05
30.6
63.45
PLBART
Parameters=140M, Mode=...
2023.05
26.97
61.59
CodeT5
Parameters=220M, Mode=...
2023.05
24.8
58.31
Feedback
Search any
task
Search any
task