Character-level Language Modeling

Benchmarks

Dataset Name	SOTA Method	Metric
enwik8 (test)	Transformer-XL + RMS dynamic eval + decay	BPC0.94	195	3d ago
text8 (test)	Transformer-XL + RMS dynamic eval + decay	BPC1.038	128	3d ago
Penn Treebank (test)	3 layer LSTM	BPC1.175	113	3d ago
Shakespeare modern	SGHMC	Accuracy55.63	48	3d ago
Hutter Prize Wikipedia (test)	mLSTM	Bits/Char1.08	28	3d ago
Penn Treebank char-level (test)	dense-IndRNN	BPC1.16	25	3d ago
text8		BPC0.98	16	3d ago
Enwik8 (val)	Adaptive Transformer	BPC1.04	15	3d ago
text8 (dev)	Transformer + adaptive span	BPC1.01	13	3d ago
enwik8 (train)	RWKV-RNN	BPC0.72	12	3d ago
enwik8 (dev)	Adaptive	BPC1	10	3d ago
Penn Treebank character-level (val)	LayerNorm HM-LSTM	BPC1.24	10	3d ago
Billion Words (test)	DGflow	JS Divergence (Context 4)0.186	4	3d ago
WikiText-2 (val)	Transformer	PPL (Validation)3.49	3	3d ago
Penn Treebank Char-level	2-LayerNorm HyperLSTM	BPC1.22	2	3d ago
Shakespeare character corpus Domain B Shifted synthetic names (Adaptation)	APN	Adaptation PPL6.38	2	3d ago
Shakespeare character corpus Domain A Original Shakespeare (Retention)	APN	Retention PPL11.12	2	3d ago

Showing 17 of 17 rows