Share your thoughts, 1 month free Claude Pro on usSee more

Coding on LiveCodeBench v6 (Score (%))

92Score (%)

Fugu-Ultra

Updated 1mo ago

Evaluation Results

Method	Links
Fugu-Ultra 2026.06		92
GPT-5.5 2026.06		90.7
Fugu 2026.06		90.3
Claude Opus 4.8 2026.06		90.3
Gemini 3.1 2026.06		88.9
Confident Decoding 2026.06		84.5
Last Layer 2026.06		83.1
Confident Decoding 2026.06		79.2
Confident Decoding 2026.06		78.3
Confident Decoding 2026.06		77.6
Last Layer 2026.06		77.1
Last Layer 2026.06		76.8
Mellum 2 (SFT) 2026.05		75.1
Last Layer 2026.06		75.1
Confident Decoding 2026.06		74.4
Confident Decoding 2026.06		73.3
Last Layer 2026.06		70.1
Mellum 2 (RL) 2026.05		69.9
Qwen3.5-9B 2026.05		68.3
ZAYA1-8B 2026.05		64.8
Keye-VL-2.0-30B-A3B 2026.06		64.2
Last Layer 2026.06		63.9
Qwen3.5 2026.06		62.8
OLMo-3-7B 2026.05		59.8
Qwen3.5-4B 2026.05		59.4
Qwen3.5-4B 2026.05		55.8
Qwen3-4B-Thinking-2507 2026.05		54.9
Gemma-4-E4B-it 2026.05		54.2
GPT-5-mini 2026.06		51.5
Ministral-3-14B 2026.05		42.7
Pair+ 2026.04		29.7
DPO 2026.04		29
Mag+ 2026.04		28.6
Soft+ 2026.04		27.5
MPO+ 2026.04		26.6
RFT 2026.04		25.3
Mag+ 2026.04		22.5
Base 2026.04		21.4
DPO 2026.04		19.5
MPO+ 2026.04		19.5
RFT 2026.04		18.7
Pair+ 2026.04		18
Soft+ 2026.04		16.1
Base 2026.04		14.9
Mag+ 2026.04		11.5
RFT 2026.04		10.7
MPO+ 2026.04		10.7
DPO 2026.04		10.6
Pair+ 2026.04		10.2
Soft+ 2026.04		9.8
Base 2026.04		9.4