Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Code Generation on Python deduplicated retrieval codebase (test)
Loading...
1,183
EM
CodeT5+
-47.32
272.09
591.5
910.91
May 13, 2023
EM
BLEU-4
CodeBLEU
Updated 4d ago
Evaluation Results
Method
Method
Links
EM
BLEU-4
CodeBLEU
CodeT5+
Evaluation Setting=Ret...
2023.05
1,183
31.14
36.39
REDCODER-EXT
Evaluation Setting=Ret...
2023.05
961
24.43
30.21
BM25
Evaluation Setting=Ret...
2023.05
0
6.63
13.49
SCODE-R
Evaluation Setting=Ret...
2023.05
0
22.75
23.92
CodeT5+
Evaluation Setting=Ret...
2023.05
0
27.3
26.51
CodeBERT
Evaluation Setting=Gen...
2023.05
0
4.06
10.42
GraphCodeBERT
Evaluation Setting=Gen...
2023.05
0
3.97
10.55
PLBART
Evaluation Setting=Gen...
2023.05
0
4.89
12.01
CodeT5+
Evaluation Setting=Gen...
2023.05
0
4.4
13.88
Feedback
Search any
task
Search any
task