Transformer-XL + RMS dynamic eval + decay
| Method | Links | ||
|---|---|---|---|
| 1.038 | - | ||
| 1.042 | - | ||
2019.07 | 1.07 | - | |
2019.05 | 1.07 | - | |
2019.11 | 1.07 | - | |
2023.08 | 1.07 | - | |
2019.11 | 1.076 | - | |
2019.07 | 1.08 | - | |
| 1.08 | - | ||
2019.05 | 1.08 | - | |
2019.11 | 1.08 | - | |
2021.02 | 1.08 | - | |
2021.07 | 1.08 | - | |
2019.11 | 1.0802 | - | |
2019.04 | 1.085 | - | |
2021.07 | 1.09 | - | |
2020.04 | 1.1 | - | |
2021.07 | 1.1 | - | |
2019.07 | 1.11 | - | |
| 1.11 | - | ||
2019.05 | 1.11 | - | |
2020.04 | 1.11 | - | |
2020.04 | 1.11 | - | |
2021.07 | 1.11 | - | |
2021.07 | 1.11 | - | |
2018.08 | 1.13 | - | |
2019.04 | 1.13 | - | |
2019.07 | 1.13 | - | |
2019.05 | 1.13 | - | |
2021.02 | 1.13 | - | |
2018.08 | 1.18 | - | |
2019.07 | 1.18 | - | |
2019.05 | 1.18 | - | |
2020.04 | 1.18 | - | |
2021.07 | 1.18 | - | |
2021.07 | 1.18 | - | |
2017.09 | 1.19 | - | |
2018.08 | 1.19 | - | |
| 1.19 | - | ||
2021.07 | 1.23 | 0.16 | |
2021.07 | 1.23 | - | |
2024.06 | 1.23 | - | |
2024.06 | 1.23 | - | |
2023.08 | 1.23 | - | |
2023.08 | 1.23 | - | |
2016.07 | 1.27 | - | |
2016.09 | 1.27 | - | |
2016.09 | 1.27 | - | |
2017.09 | 1.27 | - | |
2017.09 | 1.27 | - | |
2018.08 | 1.27 | - | |
2018.08 | 1.27 | - | |
2019.04 | 1.27 | - | |
2019.04 | 1.27 | - | |
2019.07 | 1.27 | - | |
2019.07 | 1.27 | - | |
2016.03 | 1.29 | - | |
2016.09 | 1.29 | - | |
2016.07 | 1.29 | - | |
2016.07 | 1.29 | - | |
| 1.29 | - | ||
2017.09 | 1.29 | - | |
2018.08 | 1.29 | - | |
2019.04 | 1.29 | - | |
2019.07 | 1.29 | - | |
2016.09 | 1.32 | - | |
2016.07 | 1.32 | - | |
2024.06 | 1.34 | - | |
2016.03 | 1.36 | - | |
2016.09 | 1.36 | - | |
2016.07 | 1.36 | - | |
2016.09 | 1.36 | - | |
2017.09 | 1.36 | - | |
2018.08 | 1.36 | - | |
2024.06 | 1.37 | - | |
2021.02 | 1.39 | - | |
2024.06 | 1.39 | - | |
2024.06 | 1.39 | - | |
2016.07 | 1.4 | - | |
2016.09 | 1.4 | - | |
2024.06 | 1.4 | - | |
2023.08 | 1.4 | - | |
2024.06 | 1.41 | - | |
2023.08 | 1.41 | - | |
2016.03 | 1.43 | - | |
2016.09 | 1.43 | - | |
2017.09 | 1.43 | - | |
2018.08 | 1.43 | - | |
2024.06 | 1.43 | - | |
2016.09 | 1.44 | - | |
2016.07 | 1.44 | - | |
2016.09 | 1.44 | - | |
| 1.44 | - | ||
2021.02 | 1.45 | - | |
2024.06 | 1.45 | - | |
2016.03 | 1.48 | - | |
2016.09 | 1.48 | - | |
2024.06 | 1.48 | - | |
2016.09 | 1.52 | - | |
2016.03 | 1.54 | - |