Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

AlphaResearch: Accelerating New Algorithm Discovery with Language Models

About

LLMs have made significant progress in complex but easy-to-verify problems, yet they still struggle with discovering the unknown. In this paper, we present \textbf{AlphaResearch}, an autonomous research agent designed to discover new algorithms on open-ended problems by iteratively running the following steps: (1) propose new ideas (2) program to verify (3) optimize the research proposals. To synergize the feasibility and innovation of the discovery process, we construct a novel dual environment by combining the execution-based verifiable reward and reward from simulated real-world peer review environment in AlphaResearch. We construct \textbf{\dataset}, a set of questions that includes an eight open-ended algorithmic problems competition to benchmark AlphaResearch. Experimental results show that AlphaResearch achieves stronger discovery performance than other agentic discovery systems on six open-ended problems. Notably, the algorithm discovered by AlphaResearch on the \emph{``packing circles''} problem achieves the best-of-known performance, surpassing the results of human researchers and strong baselines from recent work (e.g., AlphaEvolve). Additionally, we conduct a comprehensive analysis of the benefits and remaining challenges of autonomous research agent, providing valuable insights for future research.

Zhaojian Yu, Kaiyue Feng, Yilun Zhao, Shilin He, Xiao-Ping Zhang, Arman Cohan• 2025

Related benchmarks

TaskDatasetResultRank
GeometryAlphaResearchComp packing circles (n=26)
Objective Score2.636
3
GeometryAlphaResearchComp packing circles (n=32)
Objective Score2.939
3
Harmonic AnalysisAlphaResearchComp third autocorrelation inequality
Objective Score35.746
3
Harmonic AnalysisAlphaResearchComp autoconvolution peak minimization
Objective Score1.512
3
Combinatorial OptimizationAlphaResearchComp minimizing max-min distance ratio
Objective Score12.92
3
GeometryAlphaResearchComp spherical code (d=3, n=30)
Objective Score0.6735
3
Number TheoryAlphaResearchComp littlewood polynomials (n=512)
Objective Score32
3
Number TheoryAlphaResearchComp MSTD (n=30)
Objective Score1.04
3
Showing 8 of 8 rows

Other info

GitHub

Follow for update