Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

RESCORE: LLM-Driven Simulation Recovery in Control Systems Research Papers

About

Reconstructing numerical simulations from control systems research papers is often hindered by underspecified parameters and ambiguous implementation details. We define the task of Paper to Simulation Recoverability, the ability of an automated system to generate executable code that faithfully reproduces a paper's results. We curate a benchmark of 500 papers from the IEEE Conference on Decision and Control (CDC) and propose RESCORE, a three component LLM agentic framework, Analyzer, Coder, and Verifier. RESCORE uses iterative execution feedback and visual comparison to improve reconstruction fidelity. Our method successfully recovers task coherent simulations for 40.7% of benchmark instances, outperforming single pass generation. Notably, the RESCORE automated pipeline achieves an estimated 10X speedup over manual human replication, drastically cutting the time and effort required to verify published control methodologies. We will release our benchmark and agents to foster community progress in automated research replication.

Vineet Bhat, Shiqing Wei, Ali Umut Kaypak, Prashanth Krishnamurthy, Ramesh Karri, Farshad Khorrami• 2026

Related benchmarks

TaskDatasetResultRank
Simulation Figure ReproductionData-Driven Reachability with Christoffel Functions
FRS4
2
Simulation Figure ReproductionIdentification of Piecewise Affine Systems with Online Deterministic Annealing
FRS4
2
Simulation RecoverabilityCDC 2021 (test)
FRS-H2.09
2
Simulation RecoverabilityCDC 2022 (test)
FRS-H2.26
2
Simulation RecoverabilityCDC 2023 (test)
FRS-H2.21
2
Simulation RecoverabilityCDC 2024 (test)
FRS-H2
2
Simulation RecoverabilityCDC 2025 (test)
FRS-H2.34
2
Simulation RecoverabilityCDC All 2021-2025 combined (test)
FRS-H2.17
2
Showing 8 of 8 rows

Other info

Follow for update