Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Code Generation on ReCode Function
Loading...
38.66
pass@1
IRCoder
10.216
17.6005
24.985
32.3695
Mar 6, 2024
pass@1
Updated 4d ago
Evaluation Results
Method
Method
Links
pass@1
IRCoder
Model Size=5.7B
2024.03
38.66
DeepSeekCoder
Model Size=5.7B
2024.03
36.73
IRCoder
Model Size=1.3B
2024.03
25.75
IRCoder
Model Size=6.7B
2024.03
25.47
DeepSeekCoder
Model Size=1.3B
2024.03
25.13
CodeLlama
Model Size=6.7B
2024.03
24.49
IRCoder
Model Size=7.3B
2024.03
23.76
StarCoderBase
Model Size=7.3B
2024.03
23.53
StarCoderBase
Model Size=3.1B
2024.03
19.04
IRCoder
Model Size=3.1B
2024.03
18.8
IRCoder
Model Size=1.1B
2024.03
12.01
StarCoderBase
Model Size=1.1B
2024.03
11.31
Feedback
Search any
task
Search any
task