Share your thoughts, 1 month free Claude Pro on usSee more

Code on MBPP Sanitized (pass@1)

85.97pass@1

Nemotron-3-Ultra 550B-A55B-Base

Updated 1mo ago

Evaluation Results

Method	Links
Nemotron-3-Ultra 550B-A55B-Base 2026.06		85.97
Mistral-Large-3 675B-Base-2512 2026.06		84.08
N-3-Super 120B-A12B-Base 2026.04		78.38
GLM-4.5 Air-Base 2026.04		77.5
Ling-flash base-2.0 2026.04		77.3
GLM-4.5 Base 2026.06		76.69
Kimi-K2 Base 2026.06		72.14
DeepSeek-V3.2 Exp-Base 2026.06		58.66