Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Pre-training on Pre-training (evaluation)
Loading...
3.254
Pre-training Eval Loss
BHyT
3.22996
3.39223
3.5545
3.71677
Dec 26, 2025
Pre-training Eval Loss
Updated 4d ago
Evaluation Results
Method
Method
Links
Pre-training Eval Loss
BHyT
Backbone=Llama-3B
2025.12
3.254
LNS
Backbone=Llama-3B
2025.12
3.271
RMSNorm
Backbone=Llama-3B
2025.12
3.272
Peri-LN
Backbone=Llama-3B
2025.12
3.279
DyT
Backbone=Llama-3B
2025.12
3.855
Feedback
Search any
task
Search any
task
