Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Code Generation on CodeSearchNet (test)

0.8789BLEU

Original Prompts

0.0200680.2430340.4660.688966Sep 19, 2024
Updated 1mo ago

Evaluation Results

MethodLinks
2024.09
0.87890.92870.88690.91250.9861
2024.09
0.35040.61260.38830.50770.9226
2024.09
0.29970.59320.33990.47450.9176
2024.09
0.28810.57320.33990.4690.9156
2024.09
0.24230.54890.31260.44610.9114
2024.09
0.23580.55230.28640.43410.9112
2024.09
0.22770.54390.27340.41810.9083
2024.09
0.21130.52670.29140.42840.9081
2024.09
0.1990.52930.24350.39650.9061
2024.09
0.18460.50990.27330.41340.9052
2024.09
0.1830.51570.2250.37940.9027
2024.09
0.17590.50870.23030.38480.9022
2024.09
0.14150.47940.2020.3610.8976
2024.09
0.1340.46290.18210.34490.8933
2024.09
0.12380.46070.18730.34930.8953
2024.09
0.12110.44940.15810.3210.891
2024.09
0.11980.44950.15830.32070.8906
2024.09
0.09350.41620.12810.29210.8845
2024.09
0.09060.41510.13690.30150.8834
2024.09
0.08930.41070.1230.28870.8831
2024.09
0.07760.39090.110.27460.88
2024.09
0.07310.38880.10560.27210.8787
2024.09
0.06790.37630.09950.26490.8769
2024.09
0.06570.38630.11130.27810.8774
2024.09
0.06540.37280.09580.2620.8764
2024.09
0.05310.36620.09760.26380.8736