Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Text-to-Code generation on CodeXGLUE (test)
Loading...
22.65
EM
CodeT5-large
17.138
18.569
20
21.431
Jul 5, 2022
EM
BLEU-4
CodeBLEU
Updated 4d ago
Evaluation Results
Method
Method
Links
EM
BLEU-4
CodeBLEU
CodeT5-large
model size=large
2022.07
22.65
42.66
45.08
UniXcoder
2022.07
22.6
38.23
-
CodeT5-base
model size=base
2022.07
22.3
40.73
43.2
CodeT5-small
model size=small
2022.07
21.55
38.13
41.39
CodeGPT-adapted
2022.07
20.1
32.79
35.98
CoTexT
2022.07
20.1
37.4
40.14
PLBART
2022.07
18.75
36.69
38.52
CodeGPT-2
2022.07
18.25
28.69
32.71
GPT-2
2022.07
17.35
25.37
29.69
Feedback
Search any
task
Search any
task