Share your thoughts, 1 month free Claude Pro on usSee more

Code Generation on MBPP (Accuracy)

0.726Accuracy

Gemma 2 27B

Updated 1mo ago

Evaluation Results

Method	Links
Gemma 2 27B 2026.02		0.726
Llama 70B 2026.02		0.704
Mistral 24B 2026.02		0.672
FiMI Instruct 2026.02		0.652
NeMo 12B IT 2026.02		0.572
Llama 3.1 8B 2026.02		0.486
Mistral 7B 2026.02		0.4