Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Character-level Language Modeling on enwik8 one-million-parameter scale (val)
Loading...
1.5953
BPC
FSN, converged
1.593304
1.606777
1.62025
1.633723
Jun 17, 2026
BPC
Updated 1mo ago
Evaluation Results
Method
Method
Links
BPC
FSN, converged
Epochs=50, Number of p...
2026.06
1.5953
FSN, no phases
Epochs=30, Number of p...
2026.06
1.6031
FSN
Epochs=30, Number of p...
2026.06
1.605
Transformer, converged
Epochs=50, Number of p...
2026.06
1.611
Transformer (RoPE, SwiGLU)
Epochs=30, Number of p...
2026.06
1.6258
FSN-MF, winding register
Epochs=30, Number of p...
2026.06
1.6405
FSN-MF (no MLP anywhere; n=2)
Epochs=30, Number of p...
2026.06
1.6452
Feedback
Search any
task
Search any
task