Share your thoughts, 1 month free Claude Pro on usSee more

Code Execution on Live Code Execution

62.04Pass@1

DOMINO

Updated 5d ago

Evaluation Results

Method	Links
DOMINO 2026.05		62.04
DOMINO-Direct Domain 2026.05		60.19
QWEN2.5-CODER-14B-Instruct 2026.05		59.26
MAGPIE-Human 2026.05		57.41
MAGPIE-Few Shot 2026.05		57.41
DOMINO 2026.05		56.48
QWEN2.5-CODER-7B-Instruct 2026.05		55.55
DOMINO-Direct Domain 2026.05		50.92
MAGPIE-Few Shot 2026.05		48.15
QWEN2.5-CODER-7B-Base 2026.05		45.37
QWEN2.5-CODER-14B-Base 2026.05		45.37
DOMINO 2026.05		42.59
MAGPIE-Human 2026.05		42.59
DOMINO-Direct Domain 2026.05		38.88
Reference SFT 2026.05		38.88
OPENCODER-8B-Instruct 2026.05		37.96
Reference SFT 2026.05		36.11
MAGPIE-Few Shot 2026.05		34.26
MAGPIE-Human 2026.05		32.41
Reference SFT 2026.05		27.78
OPENCODER-8B-Base 2026.05		25.93