Pre-training
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Language Modeling | Pre-training (val) | PPL5.34 | 13 | |
| Pre-training | Pre-training (evaluation) | Pre-training Eval Loss3.254 | 5 |
Showing 2 of 2 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Language Modeling | Pre-training (val) | PPL5.34 | 13 | |
| Pre-training | Pre-training (evaluation) | Pre-training Eval Loss3.254 | 5 |