Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Line-level code completion on PY150
Loading...
44.86
EM
CodeT5+
36.6544
38.7847
40.915
43.0453
May 13, 2023
EM
Edit Sim
Updated 6d ago
Evaluation Results
Method
Method
Links
EM
Edit Sim
CodeT5+
Parameters=770M, Mode=...
2023.05
44.86
74.22
CodeT5+
Parameters=220M, Mode=...
2023.05
43.42
73.69
UniXcoder
Parameters=125M, Mode=...
2023.05
43.12
72
CodeGen-multi
Parameters=350M, Mode=...
2023.05
42.47
70.67
CodeGPT
Parameters=124M, Mode=...
2023.05
42.37
71.59
PLBART
Parameters=140M, Mode=...
2023.05
38.01
68.46
CodeT5
Parameters=220M, Mode=...
2023.05
36.97
67.12
Feedback
Search any
task
Search any
task