| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Character-level language modeling | Tiny Shakespeare (val) | Validation Loss1.355 | 19 | |
| Language Modeling | Tiny-Shakespeare | Accuracy (Test)57.93 | 14 | |
| Language Modeling | Tiny Shakespeare 32768 context length (val) | Loss2.182 | 2 |