Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Code Refinement on CodeXGLUE Code Refinement (Medium) v1.0 (test)
Loading...
91.31
BLEU-4
GraphCodeBERT
85.4964
87.0057
88.515
90.0243
Jul 5, 2022
BLEU-4
Exact Match
Updated 4d ago
Evaluation Results
Method
Method
Links
BLEU-4
Exact Match
GraphCodeBERT
2022.07
91.31
9.1
CodeBERT
2022.07
91.07
5.2
Naive copy
2022.07
90.91
0
Roborta (code)
2022.07
90.07
4.1
CodeT5-large
Model size=large
2022.07
89.22
14.76
CodeT5-small
Model size=small
2022.07
89.2
10.92
PLBART
2022.07
88.5
8.98
CoTexT
2022.07
88.4
13.11
CodeT5-base
Model size=base
2022.07
87.64
13.96
NSEdit
2022.07
85.72
13.87
Feedback
Search any
task
Search any
task