Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Language Modeling on OpenWebText ctx len. 1024 (val)
Loading...
21.43
Perplexity
PGM 6 / 6 (dim. 1024)
21.3644
21.8072
22.25
22.6928
May 24, 2025
Perplexity
Latency (sec)
Throughput (tok/sec)
Updated 4d ago
Evaluation Results
Method
Method
Links
Perplexity
Latency (sec)
Throughput (tok/sec)
PGM 6 / 6 (dim. 1024)
#Params=268M, Batch si...
2025.05
21.43
5.93
5,518.09
PGM 8 / 8
#Params=203M, Batch si...
2025.05
22.61
5.86
5,585.57
MDLM† (Compl. masking)
#Params=170M, Batch si...
2025.05
22.98
31.41
1,043.22
MDLM
#Params=170M, Batch si...
2025.05
23.07
31.41
1,043.22
Feedback
Search any
task
Search any
task