Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Code Generation on Java code generation tasks (test)
Loading...
57.3
Pass@1
PrivCode
21.212
30.581
39.95
49.319
Dec 5, 2025
Pass@1
Updated 1mo ago
Evaluation Results
Method
Method
Links
Pass@1
PrivCode
Model=Qwen2.5-Coder-7B...
2025.12
57.3
NonDPFT
Model=Qwen2.5-Coder-7B...
2025.12
55.5
PrivCode
Model=CodeQwen1.5-7B,...
2025.12
54.9
NonDPFT
Model=CodeQwen1.5-7B,...
2025.12
54.3
Pretrain
Model=Qwen2.5-Coder-7B...
2025.12
44.5
JFT
Model=Qwen2.5-Coder-7B...
2025.12
43.9
PrivCode
Model=CodeGemma-7B, ep...
2025.12
42.7
NonDPFT
Model=CodeGemma-7B, ep...
2025.12
42.1
Pretrain
Model=CodeQwen1.5-7B,...
2025.12
35.4
DPFT
Model=CodeQwen1.5-7B,...
2025.12
32.3
Pretrain
Model=CodeGemma-7B, ep...
2025.12
29.9
DPFT
Model=CodeGemma-7B, ep...
2025.12
28
DPFT
Model=Qwen2.5-Coder-7B...
2025.12
25
JFT
Model=CodeQwen1.5-7B,...
2025.12
25
JFT
Model=CodeGemma-7B, ep...
2025.12
22.6
Feedback
Search any
task
Search any
task
