Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Code Generation on Rust code generation tasks (test)
Loading...
50.6
Pass@1
NonDPFT
11.288
21.494
31.7
41.906
Dec 5, 2025
Pass@1
Updated 1mo ago
Evaluation Results
Method
Method
Links
Pass@1
NonDPFT
Model=Qwen2.5-Coder-7B...
2025.12
50.6
Pretrain
Model=Qwen2.5-Coder-7B...
2025.12
47
PrivCode
Model=Qwen2.5-Coder-7B...
2025.12
44.5
PrivCode
Model=CodeQwen1.5-7B,...
2025.12
42.7
Pretrain
Model=CodeQwen1.5-7B,...
2025.12
40.2
NonDPFT
Model=CodeQwen1.5-7B,...
2025.12
39
JFT
Model=Qwen2.5-Coder-7B...
2025.12
37.7
DPFT
Model=CodeQwen1.5-7B,...
2025.12
36
JFT
Model=CodeQwen1.5-7B,...
2025.12
32.3
NonDPFT
Model=CodeGemma-7B, ep...
2025.12
31.7
PrivCode
Model=CodeGemma-7B, ep...
2025.12
28.7
Pretrain
Model=CodeGemma-7B, ep...
2025.12
28
DPFT
Model=CodeGemma-7B, ep...
2025.12
23.8
DPFT
Model=Qwen2.5-Coder-7B...
2025.12
22
JFT
Model=CodeGemma-7B, ep...
2025.12
12.8
Feedback
Search any
task
Search any
task
