Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Ax-Prover: A Deep Reasoning Agentic Framework for Theorem Proving in Mathematics and Quantum Physics

About

We present Ax-Prover, a multi-agent system for automated theorem proving in Lean that can solve problems across diverse scientific domains and operate either autonomously or collaboratively with human experts. To achieve this, Ax-Prover approaches scientific problem solving through formal proof generation, a process that demands both creative reasoning and strict syntactic rigor. Ax-Prover meets this challenge by equipping Large Language Models (LLMs), which provide knowledge and reasoning, with Lean tools via the Model Context Protocol (MCP), which ensure formal correctness. To evaluate its performance as an autonomous prover, we benchmark our approach against frontier LLMs and specialized prover models on two public math benchmarks and on two Lean benchmarks we introduce in the fields of abstract algebra and quantum theory. On public datasets, Ax-Prover is competitive with state-of-the-art provers, while it largely outperforms them on the new benchmarks. This shows that, unlike specialized systems that struggle to generalize, our tool-based agentic theorem prover approach offers a generalizable methodology for formal verification across diverse scientific domains. Furthermore, we demonstrate Ax-Prover's assistant capabilities in a practical use case, showing how it enabled an expert mathematician to formalize the proof of a complex cryptography theorem.

Benjamin Breen, Marco Del Tredici, Jacob McCarran, Javier Aspuru Mijares, Weichen Winston Yin, Kfir Sulimany, Jacob M. Taylor, Frank H. L. Koppens, Dirk Englund• 2025

Related benchmarks

TaskDatasetResultRank
Formal Theorem ProvingPutnamBench
Solved Count91
42
Theorem ProvingPutnamBench (test)
Accuracy14
13
Formal Theorem ProvingNuminaMath-LEAN (solved-H)
Accuracy47
4
Formal Theorem ProvingNuminaMath LEAN (unsolved)
Accuracy26
4
Formal Theorem ProvingNuminaMath-LEAN (total)
Accuracy51
4
Formal Theorem ProvingAbstractAlgebra easy
Accuracy72
4
Formal Theorem ProvingAbstractAlgebra intermediate
Accuracy56
4
Formal Theorem ProvingAbstractAlgebra (total)
Accuracy64
4
Formal Theorem ProvingQuantumTheorems easy
Accuracy100
4
Formal Theorem ProvingQuantumTheorems (intermediate)
Accuracy92
4
Showing 10 of 12 rows

Other info

Follow for update