Our new X account is live! Follow @wizwand_team for updates

Language Modeling on C4 (train)

15.28PPL

8-bit COAP

Updated 3d ago

Evaluation Results

Method	Links
8-bit COAP 2024.11		15.28
8-bit Adam 2024.11		15.39
8-bit GaLore 2024.11		15.47
AdamW 2024.11		15.56
COAP 2024.11		15.56
GaLore 2024.11		15.64
ReLORA 2024.11		18.33
LoRA 2024.11		19.21