Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Language Modeling on Paloma-C4 (val)
Loading...
58.48
Perplexity
Partially Reverse BDLM Mamba-H
57.4892
64.1771
70.865
77.5529
Jul 2, 2026
Perplexity
Bits Per Byte (BPB)
Updated 18d ago
Evaluation Results
Method
Method
Links
Perplexity
Bits Per Byte (BPB)
Partially Reverse BDLM Mamba-H
LR=8×10−3
2026.07
58.48
1.28
BDLM attention
LR=4×10−3
2026.07
70.81
1.34
Full-sequence DiffuMamba-H
LR=4×10−3
2026.07
80.42
1.38
Full-sequence attention
LR=8×10−3
2026.07
83.25
1.39
Feedback
Search any
task
Search any
task