Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Code Generation on MBPP (MBPP metric)
Loading...
70.2
MBPP Score
OPTIMER
36.504
45.252
54
62.748
Mar 30, 2026
MBPP Score
Updated 18d ago
Evaluation Results
Method
Method
Links
MBPP Score
OPTIMER
Base Model=Gemma 3 27B
2026.03
70.2
OPTIMER
Base Model=SEA-LION v4
2026.03
66
SEA-LION v4 27B IT
2026.03
57.6
Gemma 3 27B IT
2026.03
37.8
Feedback
Search any
task
Search any
task
