Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Code Generation on ReCode Syntax
Loading...
59.24
Pass@1
IRCoder
25.076
33.9455
42.815
51.6845
Mar 6, 2024
Pass@1
Updated 4d ago
Evaluation Results
Method
Method
Links
Pass@1
IRCoder
Model Size=5.7B
2024.03
59.24
DeepSeekCoder
Model Size=5.7B
2024.03
55.43
IRCoder
Model Size=6.7B
2024.03
48.11
IRCoder
Model Size=1.3B
2024.03
45.43
CodeLlama
Model Size=6.7B
2024.03
45.23
DeepSeekCoder
Model Size=1.3B
2024.03
44.88
IRCoder
Model Size=7.3B
2024.03
41.82
StarCoderBase
Model Size=7.3B
2024.03
41.5
IRCoder
Model Size=3.1B
2024.03
34.42
StarCoderBase
Model Size=3.1B
2024.03
33.29
IRCoder
Model Size=1.1B
2024.03
27.5
StarCoderBase
Model Size=1.1B
2024.03
26.39
Feedback
Search any
task
Search any
task