mathlib
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Lean type to informal description retrieval | mathlib (test) | R@172.77 | 18 | |
| Informal description to Lean signature retrieval | mathlib | R@167.4 | 9 | |
| Informal description to Lean type retrieval | mathlib (test) | R@170.18 | 9 | |
| Lean signature to Lean type retrieval | mathlib v4.16.0 | R@173.34 | 9 | |
| Mathematical Retrieval | mathlib Lean type to Lean signature (test) | R@165.26 | 9 | |
| Formal Theorem Proving | mathlib (val) | Pass@162.6 | 9 | |
| Proof Optimization (Length) | Mathlib | Improvement6.19 | 4 | |
| Library Overlap Analysis | Mathlib | Overlap5 | 3 | |
| Formal Theorem Proving | mathlib (test) | Pass@163 | 3 | |
| Proof Optimization (Declarativity) | Mathlib | Improvement4.63 | 2 |
Showing 10 of 10 rows