Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Language Modeling on WikiText (held-out)

9.8Perplexity (PPL)

Before finetune

7.850421.010234.1747.3298Jun 12, 2024Aug 9, 2024Oct 6, 2024Dec 4, 2024Jan 31, 2025Mar 30, 2025May 28, 2025
Updated 4d ago

Evaluation Results

MethodLinks
2024.06
9.8
2024.06
9.81
2024.06
9.95
2024.06
14.85
2024.06
15.44
2024.06
15.75
2024.06
16.98
2024.06
17.59
2025.05
18.3599
2024.06
18.43
2025.05
18.4967
2025.05
18.5452
2025.05
18.6897
2025.05
18.9281
2025.05
18.931
2025.05
19.1467
2024.06
19.43
2025.05
19.8609
2025.05
20.1854
2025.05
20.3899
2024.06
23.56
2024.06
35.71
2024.06
42.14
2024.06
48.13
2024.06
58.54