| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Character-level Language Modeling | text8 (test) | BPC1.038 | 128 | |
| Language Modeling | text8 | BPC1.02 | 23 | |
| Language Modeling | Text8 (test) | BPC1.23 | 21 | |
| Language Modeling | Text8 word-level (test) | Perplexity99.9 | 19 | |
| Language Modeling | Text8 word-level (val) | Perplexity81.64 | 18 | |
| Character-level language modeling | text8 | BPC0.98 | 16 | |
| Character-level language modeling | text8 (dev) | BPC1.01 | 13 | |
| Language Modeling | text8 English (test) | BPC1.133 | 8 | |
| Text Generation | text8 | BPC1.45 | 2 | |
| Unconditional text generation | text8 unconditional | Metric- | 0 |