| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Language Modeling | Wiki-40B (val) | Perplexity14.955 | 35 | |
| Text Compression | Wiki-40B 6160MB | Description Length (MB)971 | 8 | |
| Text Compression | Wiki-40B | Compressed Size (MB)214 | 8 | |
| Text Compression | Wiki-40B 300MB | Description Length (MB)61 | 8 |