SOTA Code Generation on LiveCodeBench (LCB) (Pass@1) and PapersWithCode

91.7Pass@1

Gemini-3-Pro

Updated 1mo ago

Evaluation Results

Method	Links
Gemini-3-Pro 2026.06		91.7
Claude-Opus-4.5 2026.06		87.1
GPT-5.1 2026.06		87
GLM-4.7 2026.06		84.9
DeepSeek-V3.2 2026.06		83.3
Qwen-7B 2026.03		66
R1-Distill-Qwen-7B 2026.03		59
Qwen-7B 2026.03		55
Qwen-7B 2026.03		54
Qwen3-Coder-480B-A35B-Instruct 2026.06		53.9
Kimi-K2-Instruct-0905 2026.06		53.7
Qwen3-235B-A22B-Instruct-2507 2026.06		51.8
Qwen-7B 2026.03		51
Qwen-3B 2026.03		50
Qwen-7B 2026.03		48
Kimi-Dev-72B 2026.06		40
Qwen-3B 2026.03		38
Qwen-7B 2026.03		36
Qwen3-14B 2025.05		35.8
INTUITOR 2025.05		35.6
LoopCoder-v2 2026.06		35.4
INTUITOR 2025.05		30
GRPO 2025.05		29.6
LoopCoder-v2 2026.06		28.6
Qwen2.5-Coder-32B-Instruct 2026.06		27.4
LoopCoder-v2 2026.06		27.4
Qwen2.5-Coder-14B-Instruct 2026.06		24.6
LoopCoder-v2 2026.06		24.5
Qwen-3B 2026.03		23
Qwen-3B 2026.03		23
Seed-Coder-8B-Instruct 2026.06		22.3
Qwen2.5-14B 2025.05		22
GRPO 2025.05		20
DeepSeek-Coder-V2-Lite-Instruct 2026.06		19.4
INTUITOR 2025.05		19
Qwen2.5-Coder-7B-Instruct 2026.06		18.9
Qwen2.5-7B 2025.05		2.6