| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| Isabelle (IS) Premise Selection (test) | Llama-3.1 (RULES) | Exact Match Accuracy86.3 | 12 | 4mo ago | |
| HolStep (test) | FormulaNet | Accuracy90.3 | 8 | 4mo ago | |
| Premise Selection (val) | Recall26.4 | 6 | 1mo ago | ||
| LeanDojo Benchmark 4 Lean 3 (novel_premises) | ReProver | R@19.8 | 6 | 4mo ago | |
| LeanDojo Benchmark (random) | ReProver (Ours) | R@113.5 | 5 | 4mo ago | |
| Dl (test) | GPT | Accuracy83 | 4 | 2mo ago | |
| Ds (test) | T5 | Accuracy99 | 4 | 2mo ago | |
| D (test) | T5 | Accuracy94 | 2 | 2mo ago | |
| Mizar (test) | BidirDagLSTM-AttDagLSTM | Accuracy81 | 2 | 4mo ago | |
| LeanDojo Benchmark 4 Lean 3 (random) | ReProver | R@112.8 | 1 | 4mo ago |
