Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Theorem Proving on LeanDojo (novel premises)
Loading...
41.11
Pass@1
LeanListener
3.8676
13.5363
23.205
32.8737
Jun 27, 2023
Oct 9, 2023
Jan 21, 2024
May 4, 2024
Aug 16, 2024
Nov 28, 2024
Mar 12, 2025
Pass@1
Updated 4d ago
Evaluation Results
Method
Method
Links
Pass@1
LeanListener
Policy Opt. Method=GRP...
2025.03
41.11
ReProver*
Notes=Newly provided p...
2025.03
40.86
ReProver
2025.03
26.3
ReProver
retrieval=true
2023.06
26.3
ReProver (w/o retrieval)
2025.03
23.2
ReProver
retrieval=false
2023.06
23.2
ReProver
retrieval=enabled
2023.06
19.9
W/o retrieval
retrieval=disabled
2023.06
16.2
GPT-4
2025.03
7.4
GPT-4
mode=zero-shot, tactic...
2023.06
7.4
tidy
2025.03
5.3
tidy
2023.06
5.3
Feedback
Search any
task
Search any
task