| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Language Modeling | Proofpile (test) | Performance (8K Context)3.68 | 12 | |
| Language Modeling | ProofPile (16K) | Perplexity3.24 | 8 | |
| Language Modeling | ProofPile (4K) | Perplexity3.26 | 8 | |
| Language Modeling | ProofPile 100K | Perplexity3.19 | 6 | |
| Language Modeling | ProofPile 32K | Perplexity3.21 | 6 |