Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Code Generation on Java deduplicated retrieval codebase (test)
Loading...
11.66
EM
CodeT5+
-0.4664
2.6818
5.83
8.9782
May 13, 2023
EM
BLEU-4
CodeBLEU
Updated 4d ago
Evaluation Results
Method
Method
Links
EM
BLEU-4
CodeBLEU
CodeT5+
Evaluation Setting=Ret...
2023.05
11.66
33.83
40.6
REDCODER-EXT
Evaluation Setting=Ret...
2023.05
10.21
28.98
33.18
BM25
Evaluation Setting=Ret...
2023.05
0
4.9
16
SCODE-R
Evaluation Setting=Ret...
2023.05
0
25.34
26.68
CodeT5+
Evaluation Setting=Ret...
2023.05
0
28.74
31
CodeBERT
Evaluation Setting=Gen...
2023.05
0
8.38
14.52
GraphCodeBERT
Evaluation Setting=Gen...
2023.05
0
7.86
14.53
PLBART
Evaluation Setting=Gen...
2023.05
0
10.1
14.96
CodeT5+
Evaluation Setting=Gen...
2023.05
0
10.33
20.54
Feedback
Search any
task
Search any
task