Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Next token prediction on Pre-training corpus (train)
Loading...
66.4
Token Accuracy
LIME+1
40.92
47.535
54.15
60.765
Dec 8, 2025
Token Accuracy
Perplexity
Updated 3d ago
Evaluation Results
Method
Method
Links
Token Accuracy
Perplexity
LIME+1
Size=2B, Total Paramet...
2025.12
66.4
4.28
LIME+1
Size=1B, Total Paramet...
2025.12
64.86
4.73
LIME+1
Size=500M, Total Param...
2025.12
61.83
5.77
LIME
Size=2B, Total Paramet...
2025.12
47.95
12.1
Baseline
Size=2B, Total Paramet...
2025.12
46.92
12.82
LIME
Size=1B, Total Paramet...
2025.12
46.21
14.02
Baseline
Size=1B, Total Paramet...
2025.12
45.2
14.84
LIME
Size=500M, Total Param...
2025.12
42.91
18.5
Baseline
Size=500M, Total Param...
2025.12
41.9
19.72
Feedback
Search any
task
Search any
task