Language Modeling on LM1B ctx len. 128 (val)
25.72PPL (Val)
MDLM† (Compl. masking)
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2025.05 | 25.72 | 3.78 | 1,081.57 | |
2025.05 | 26.8 | 2.12 | 1,930.93 | |
2025.05 | 27.67 | 3.78 | 1,081.57 |
MDLM† (Compl. masking)
| Method | Links | |||
|---|---|---|---|---|
2025.05 | 25.72 | 3.78 | 1,081.57 | |
2025.05 | 26.8 | 2.12 | 1,930.93 | |
2025.05 | 27.67 | 3.78 | 1,081.57 |