Lean
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Formal theorem proving | Lean (test) | Pass@173 | 14 | |
| Theorem Retrieval | Lean Augmented Statement | R@182.7 | 4 | |
| Theorem Retrieval | Lean Synthetic User Query (Sec. 3.1) | Recall@154.4 | 4 | |
| Theorem Retrieval | Lean Informalized Statement | R@164.2 | 4 | |
| Theorem Retrieval | Lean Augmented Statement cleaned (test) | R@186.8 | 2 | |
| Theorem Retrieval | Lean Synthetic User Query cleaned (test) | Recall@157.3 | 2 | |
| Theorem Retrieval | Lean Informalized Statement cleaned (test) | R@165.7 | 2 |
Showing 7 of 7 rows