Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Code Generation on ReCode Format
Loading...
65.76
Pass@1
IRCoder
26.5728
36.7464
46.92
57.0936
Mar 6, 2024
Pass@1
Updated 4d ago
Evaluation Results
Method
Method
Links
Pass@1
IRCoder
Model Size=5.7B
2024.03
65.76
DeepSeekCoder
Model Size=5.7B
2024.03
62.37
IRCoder
Model Size=6.7B
2024.03
56.41
CodeLlama
Model Size=6.7B
2024.03
54.5
IRCoder
Model Size=1.3B
2024.03
49.85
DeepSeekCoder
Model Size=1.3B
2024.03
49.61
IRCoder
Model Size=7.3B
2024.03
46.62
StarCoderBase
Model Size=7.3B
2024.03
46.3
IRCoder
Model Size=3.1B
2024.03
39.78
StarCoderBase
Model Size=3.1B
2024.03
38.7
IRCoder
Model Size=1.1B
2024.03
30.18
StarCoderBase
Model Size=1.1B
2024.03
28.08
Feedback
Search any
task
Search any
task