Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Code Generation on MBPP base standard (test)
Loading...
66.17
Pass@1
PiSSA
34.2732
42.5541
50.835
59.1159
Feb 5, 2026
Pass@1
Updated 4d ago
Evaluation Results
Method
Method
Links
Pass@1
PiSSA
Model=Gemma-7B, Params...
2026.02
66.17
LoRA
Model=Gemma-7B, Params...
2026.02
65.58
PiSSA + Ours
Model=Gemma-7B, Params...
2026.02
62.97
PiSSA
Model=Mistral-7B, Para...
2026.02
62.55
LoRA + Ours
Model=Gemma-7B, Params...
2026.02
62.07
LoRA + Ours
Model=Mistral-7B, Para...
2026.02
61.8
PiSSA + Ours
Model=Mistral-7B, Para...
2026.02
60.9
LoRA
Model=Mistral-7B, Para...
2026.02
58.46
Full FT
Model=Gemma-7B, Params...
2026.02
55.67
Full FT
Model=Mistral-7B, Para...
2026.02
51.46
PiSSA + Ours
Model=LLaMA 2-7B, Para...
2026.02
40.5
LoRA + Ours
Model=LLaMA 2-7B, Para...
2026.02
37.67
PiSSA
Model=LLaMA 2-7B, Para...
2026.02
37.24
Full FT
Model=LLaMA 2-7B, Para...
2026.02
35.59
LoRA
Model=LLaMA 2-7B, Para...
2026.02
35.5
Feedback
Search any
task
Search any
task