Share your thoughts, 1 month free Claude Pro on usSee more

Code Generation on MBPP (Score %)

66.17MBPP Score

PiSSA

Updated 1mo ago

Evaluation Results

Method	Links
PiSSA 2024.04		66.17
Qwen2-7B 2024.07		65.9
LoRA 2024.04		65.58
LoRA 2024.04		65.25
PiSSA 2024.04		62.55
LoRA 2024.04		58.46
LoRA 2024.04		58.39
Full FT 2024.04		55.67
Llama-3-8B 2024.07		53.9
Qwen2-1.5B 2024.07		51.9
Qwen1.5-7B 2024.07		51.6
Full FT 2024.04		51.46
Mistral-7B 2024.07		51.1
Gemma-7B 2024.07		50.6
PRINMIX 2025.06		50.2
PRINMIX 2025.06		50
Aligned 2025.06		48.9
LoRA 2025.06		47.7
PRINMIX-LoRA 2025.06		47.7
Backbone 2025.06		46
KEEL 2026.01		42.6
Qwen2-0.5B 2024.07		37.8
Pre-LN 2026.01		37.6
Qwen-1.5 7B 2024.07		37.4
PiSSA 2024.04		37.24
Full FT 2024.04		35.59
LoRA 2024.04		35.5
LoRA 2024.04		35.47
Qwen1.5-1.8B 2024.07		28.6
DDK 2024.07		24.98
MiniLLM 2024.07		23.31
KD 2024.07		22.69
CPT 2024.07		20.45
Qwen-1.5 1.8B 2024.07		18
Qwen1.5-0.5B 2024.07		14.5