Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DeepCode: Open Agentic Coding

About

Recent advances in large language models (LLMs) have given rise to powerful coding agents, making it possible for code assistants to evolve into code engineers. However, existing methods still face significant challenges in achieving high-fidelity document-to-codebase synthesis--such as scientific papers to code--primarily due to a fundamental conflict between information overload and the context bottlenecks of LLMs. In this work, we introduce DeepCode, a fully autonomous framework that fundamentally addresses this challenge through principled information-flow management. By treating repository synthesis as a channel optimization problem, DeepCode seamlessly orchestrates four information operations to maximize task-relevant signals under finite context budgets: source compression via blueprint distillation, structured indexing using stateful code memory, conditional knowledge injection via retrieval-augmented generation, and closed-loop error correction. Extensive evaluations on the PaperBench benchmark demonstrate that DeepCode achieves state-of-the-art performance, decisively outperforming leading commercial agents such as Cursor and Claude Code, and crucially, surpassing PhD-level human experts from top institutes on key reproduction metrics. By systematically transforming paper specifications into production-grade implementations comparable to human expert quality, this work establishes new foundations for autonomous scientific reproduction that can accelerate research evaluation and discovery.

Zongwei Li, Zhonghang Li, Zirui Guo, Xubin Ren, Chao Huang• 2025

Related benchmarks

TaskDatasetResultRank
General RecommendationGeneralRec
Performance Gap28.66
6
Graph Structure LearningGSL
Performance Gap65.11
6
Long-term time-series forecastingLongTerm
Performance Gap34.22
6
Multimodal RecommendationMMRec
Performance Gap64.58
6
Noisy Graph LearningNoisyGL
Performance Gap31.08
6
Sequential RecommendationSeqRec
Performance Gap61.24
6
Time Series Anomaly DetectionAnomalyDetection
Performance Gap62.88
6
General Graph LearningGeneralGL
Performance Gap61.77
6
Short-term Time Series ForecastingShortTerm
Performance Gap60.13
6
Time-series classificationClassification
Performance Gap63.11
6
Showing 10 of 11 rows

Other info

GitHub

Follow for update