Pre-training corpus
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Language Modeling | Pre-training corpus (train) | Perplexity15.71 | 20 | |
| Next token prediction | Pre-training corpus (train) | Token Accuracy66.4 | 9 |
Showing 2 of 2 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Language Modeling | Pre-training corpus (train) | Perplexity15.71 | 20 | |
| Next token prediction | Pre-training corpus (train) | Token Accuracy66.4 | 9 |