Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Character-level Language Modeling on enwik8 (test)

0.94BPC

Transformer-XL + RMS dynamic eval + decay

0.929680.999341.0691.13866May 24, 2017Jun 22, 2018Jul 21, 2019Aug 18, 2020Sep 16, 2021Oct 15, 2022Nov 14, 2023
Updated 4d ago

Evaluation Results

MethodLinks
2019.04
0.94---
2019.04
0.946---
2021.10
0.95---
2021.10
0.96---
2019.11
0.968---
2019.11
0.97---
2019.11
0.97---
2020.04
0.97---
2021.07
0.97---
2021.07
0.97---
2021.10
0.97---
2019.11
0.9752---
2019.07
0.98---
2019.07
0.98---
2019.05
0.98---
2019.11
0.98---
2019.11
0.98---
2019.11
0.98---
2020.04
0.98---
2021.07
0.98---
2021.10
0.98---
2021.10
0.98---
2019.01
0.99---
2019.07
0.99---
2019.07
0.99---
2019.05
0.99---
2019.11
0.99---
2019.11
0.99---
2019.11
0.99---
2020.04
0.99---
2020.04
0.99---
2020.04
0.99---
2020.04
0.99---
2021.07
0.99---
2021.07
0.99---
2021.07
0.99---
2021.07
0.99---
2021.07
0.99---
2021.10
0.99---
2019.11
0.991---
2019.04
0.993---
2020.04
1---
2021.07
1---
2019.07
1.01---
2019.07
1.02---
2019.05
1.02---
2019.11
1.02---
2020.04
1.02---
2020.04
1.02---
2021.07
1.02---
2021.07
1.02---
2022.09
1.02---
2023.06
1.02---
2023.06
1.02-11
2023.06
1.02-1.161.07
2023.11
1.02---
2019.01
1.03---
2019.07
1.03---
2019.05
1.03---
2019.11
1.03---
2020.04
1.03---
2021.07
1.03---
2023.11
1.033---
2023.11
1.037---
2020.04
1.05---
2021.07
1.05---
2019.04
1.06---
2019.01
1.06---
2019.01
1.06---
2019.07
1.06---
2019.07
1.06---
2019.05
1.06---
2019.05
1.06---
2019.11
1.06---
2019.11
1.06---
2019.11
1.06---
2020.04
1.06---
2021.07
1.06---
2022.09
1.06---
2023.06
1.06---
2023.11
1.06---
2023.11
1.06---
2019.11
1.068---
2019.11
1.076---
2019.04
1.08---
2019.01
1.11---
2019.07
1.11---
2019.05
1.11---
2019.11
1.11---
2020.04
1.11---
2021.07
1.11---
2023.11
1.11---
2023.05
1.13---
2023.05
1.137---
2019.11
1.146---
2023.05
1.178---
2017.09
1.19---
2019.11
1.195---
2023.05
1.195---
2017.05
1.198---
Showing 100 of 229 rows