Share your thoughts, 1 month free Claude Pro on usSee more

Code Generation on HumanEval (in-domain)

47.56Pass@1

LoRA (r = 32)

Updated 12d ago

Evaluation Results

Method	Links
LoRA (r = 32) 2025.06		47.56
MoRAM 2025.06		47.56
LoRA (r = 16) 2025.06		45.73
LoRA (r = 8) 2025.06		44.51
LoRA (r = 4) 2025.06		41.46
Llama-3.1-8B 2025.06		38.4