Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

RedPajama

Benchmarks

Task NameDataset NameSOTA ResultTrend
Language ModelingRedPajama LLaMA pretraining corpus (evaluation slice)
Perplexity (bits/byte)0.62
15
Safety EvaluationRedPajama Safety Evals (test)
Safety Score (Avg)93.4
7
Generation QualityRedPajama Generation Quality Prefixes (test)
Standard Prefix Count32.4
4
Showing 3 of 3 rows