Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

VERITAS: Verifier-Guided Proof Search for Zero-Shot Formal Theorem Proving

About

LLM-based formal provers often collapse rich verifier signals (syntax errors, type mismatches, partial goal progress) into a binary pass/fail bit. We present VERITAS, a zero-shot framework that routes every verifier signal back into proof search through a two-phase protocol: Best-of-N sampling first, then a critic-guided MCTS pass that ingests Phase 1 failures as explicit negative examples. The protocol preserves every theorem solved by its own Phase 1 sweep, so Phase 2's additional solves are attributable to feedback-driven exploration. VERITAS reaches 40.6% on miniF2F (vs. an independently run Best-of-5 at 36.9%, Portfolio 26.2%) and 7.3% on VERITAS-CombiBench, a 55-theorem combinatorics benchmark we release on which Best-of-5 (1.8%) falls below Portfolio (3.6%), exposing that unguided sampling hurts when correct lemma names must be recovered iteratively from verifier feedback. Artifacts are available on GitHub.

Manish Acharya, Zhenyu Liao, Yueke Zhang, Kevin Leach, Yu Huang, Yifan Zhang• 2026

Related benchmarks

TaskDatasetResultRank
Formal Theorem ProvingMiniF2F (test)
Pass@140.6
157
Formal Theorem ProvingminiF2F full n=244
Total Solve Rate40.6
4
Formal Theorem ProvingVERITAS-CombiBench n=55
Total Solve Rate7.3
4
Formal Theorem ProvingminiF2F 201-problem hard
Total Solve Rate19.4
2
Showing 4 of 4 rows

Other info

Follow for update