SOTA Code benchmarks and papers with code

Benchmarks

Dataset Name	SOTA Method	Metric
HumanEval		HumanEval Accuracy95.1	79	3d ago
MBPP	PrivCode	Pass@177.9	49	11d ago
HumanEval+	SUN	Accuracy79.9	34	1mo ago
LiveCodeBench V5-6	Reasoning Memory	Accuracy50.8	33	15d ago
LiveCodeBench V1-4	Reasoning Memory	Accuracy47.1	33	15d ago
HumanEval (test)	LightMoE	HumanEval Success Rate58.1	14	1mo ago
LCB v6		Score87.7	11	22d ago
MBPP 1,000-example (test)	Qwen3-VL-2B-Instruct	Perplexity9.0212	10	1mo ago
HumanEval pass@1		Pass@167.07	9	1mo ago
SWE Verified Agentless		pass@157.6	8	1mo ago
LCB Pro Med 25Q2	Nemotron-Cascade 14B-Thinking	pass@110.5	7	1mo ago
LCB Pro Easy 25Q2	Nemotron-Cascade 14B-Thinking	Pass@168.9	7	1mo ago
LCB 08/24-02/25 v5	Nemotron-Cascade 14B-Thinking	pass@177.5	7	1mo ago
CRUX		Accuracy66.4	6	1mo ago
APT-Bench	Qwen3	Accuracy41.9	6	1mo ago
MBPP+	AdaRAS	Accuracy60.58	6	1mo ago
GRAFITE Sample Code	Llama-4-Maverick-17B-128E-Instruct	Pass Rate100	4	29d ago
EnConda-Bench	Youtu-LLM 2B	Accuracy0.215	4	1mo ago
CruxEval o	Engram-40B	Exact Match35.3	4	1mo ago
CruxEval-i	Engram-40B	Exact Match36.2	4	1mo ago
MBPP Sanitized	N-3-Super 120B-A12B-Base	pass@178.38	3	3d ago
LiveCodeBench EN	Qwen3-8B	Score63.39	2	1mo ago

Showing 22 of 22 rows