SlimPajama
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Language Modeling | SlimPajama (test) | PPL (CommonCrawl)0.5402 | 23 | |
| Language Modeling | SlimPajama | Perplexity (PPL)7.4 | 12 | |
| Language Modeling | SlimPajama large-scale (train) | L(ψ)2.129 | 8 | |
| Language Modeling | SlimPajama (val) | Perplexity23.2 | 6 | |
| Factuality Evaluation | SlimPajama | Pointwise Score63.5 | 3 | |
| Generation Quality and Coherence Evaluation | SlimPajama Quality Evaluation (test) | Gen Quality (Std. Prefix)86.3 | 3 | |
| Language Modeling | SlimPajama 10M (dev) | Perplexity9.219 | 3 |
Showing 7 of 7 rows