Our new X account is live! Follow @wizwand_team for updates

Language Modeling on Text8 (test)

1.23BPC

Transformer AR

Updated 4d ago

Evaluation Results

Method	Links
Transformer AR 2024.10		1.23
AR Discrete Flow 2024.10		1.23
Transformer AR 2026.02		1.23
AR Discrete Flow 2026.02		1.23
EDLM 2024.10		1.24
MD4 2024.10		1.37
MD4 2026.02		1.37
AR Argmax Flow 2024.10		1.39
AR Argmax Flow 2026.02		1.39
MDLM 2024.10		1.4
MDLM 2026.02		1.4
MAC 2026.02		1.4
SEDD Absorb 2026.02		1.41
ARDM 2026.02		1.43
DSL 2026.02		1.45
D3PM Absorb 2026.02		1.45
Plaid 2026.02		1.48
D3PM Uniform 2026.02		1.61
Mult. Diffusion 2026.02		1.72
IAF/SCF 2024.10		1.88
IAF/SCF 2026.02		1.88