Share your thoughts, 1 month free Claude Pro on usSee more

Code Generation on FullStackBench

72.3Pass@1

Claude-Opus-4.5

Updated 1mo ago

Evaluation Results

Method	Links
Claude-Opus-4.5 2026.03		72.3
IQuest-Coder-V1-40B-Instruct 2026.03		71.4
GLM-4.7 2026.03		70.2
Claude-Sonnet-4.5 2026.03		69.7
IQuest-Coder-V1-40B-Loop-Instruct 2026.03		68.3
Qwen3-Coder-480B-A35B-Instruct 2026.03		66.4
Deepseek-V3.2 2026.03		64.9
GPT-5.1 2026.03		64.9
LongCat-Flash Exp-Chat 2025.12		64.1
Kimi-K2-Instruct-0905 2026.03		63.5
Qwen3-235B-A22B-Instruct-2507 2026.03		62.7
DeepSeek V3.2 2025.12		62.5
LongCat-Flash Chat 2025.12		61.8
GLM 4.6 2025.12		61
Qwen3-Coder-30B-A3B-Instruct 2026.03		60.9
Claude-3.5-Sonnet-20241022 2025.12		60.7
IQuest-Coder-V1-40B-Loop-Thinking 2026.03		59.5
GPT-4o-2024-08-06 2025.12		58.89
KAT-Dev 2026.03		58.8
Qwen2.5-Coder-32B-Instruct 2026.03		57.4
Qwen2.5-Coder-32B-Instruct 2025.12		56.88
DS-Coder-V2-Instruct 2025.12		56.37
Seed-Coder-8B-Instruct 2026.03		55.8
Qwen2.5-Coder-14B-Instruct 2025.12		55.28
IQuest-Coder-V1-40B-Thinking 2026.03		54.8
UCoder-32B 2025.12		53.35
Qwen2.5-Coder-14B-Instruct 2026.03		53.1
KAT-Dev-72B-Exp 2026.03		52.9
UCoder-14B 2025.12		52.52
UCoder-7B 2025.12		51.27
DeepSeek-Coder-V2-Lite-Instruct 2026.03		49.4
IQuest-Coder-V1-14B-Instruct 2026.03		48.6
DS-Coder-33B-Instruct 2025.12		48.19
Qwen2.5-Coder-7B-Instruct 2025.12		47.95
IQuest-Coder-V1-14B-Thinking 2026.03		46.6
Starcoder2-15B-Instruct-v0.1 2025.12		42.68
Qwen2.5-Coder-7B-Instruct 2026.03		42.2
OpenCoder-8B-Instruct 2025.12		41.08
DS-Coder-6.7B-Instruct 2025.12		40.16
IQuest-Coder-V1-7B-Instruct 2026.03		39.7
Kimi-Dev-72B 2026.03		38.6
IQuest-Coder-V1-7B-Thinking 2026.03		32.3
CodeLlama-34B-Instruct 2025.12		27.56
CodeLlama-13B-Instruct 2025.12		27
CodeLlama-7B-Instruct 2025.12		25.4