Our new X account is live! Follow @wizwand_team for updates

Language Modeling on OpenWebText 1 (val)

14.66Validation Perplexity

G-Lion

Updated 4d ago

Evaluation Results

Method	Links
G-Lion 2024.03		14.66
D-Lion (MaVo) 2024.03		14.66
D-Lion (Avg) 2024.03		14.69
AdamW 2024.03		14.7
G-Lion 2024.03		18.35
D-Lion (MaVo) 2024.03		18.37
D-Lion (Avg) 2024.03		18.39
AdamW 2024.03		18.43