| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Character-level Language Modeling | enwik8 (test) | BPC0.94 | 195 | |
| Character-level language modeling | Enwik8 (val) | BPC1.04 | 15 | |
| Character-level Language Modeling | enwik8 (train) | BPC0.72 | 12 | |
| Character level language modeling | enwik8 (dev) | BPC1 | 10 | |
| Lossless Data Compression | enwik8 | Compressed Size (Bytes)14,915,298 | 4 | |
| Density modeling | Enwik8 (test) | Bits per Byte0.99 | 4 |