| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Language Modeling | Stories (test) | Bits Per Byte0.809 | 6 | |
| Sentence Infilling | STORIES (test) | Performance Score45 | 4 | |
| Language Model Inference | stories100m 110M parameters | Tokens/s298.7 | 3 | |
| Open-ended text generation evaluation (Discriminator Accuracy) | Stories | Gen. PPL0.643 | 1 |