Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Language Modeling on Wikitext-2 (PPL)
Loading...
13.9
Perplexity (PPL)
Vanilla
13.824
14.337
14.85
15.363
May 28, 2026
Perplexity (PPL)
Updated 2d ago
Evaluation Results
Method
Method
Links
Perplexity (PPL)
Vanilla
Backbone=Mistral-7B-In...
2026.05
13.9
DT-CD⋆
Backbone=Mistral-7B-In...
2026.05
13.9
COFT
Backbone=Mistral-7B-In...
2026.05
13.9
SDD
Backbone=Mistral-7B-In...
2026.05
14.1
DExperts
Backbone=Mistral-7B-In...
2026.05
14.2
Vanilla
Backbone=LLaMA-2-13B
2026.05
15.3
DT-CD⋆
Backbone=LLaMA-2-13B
2026.05
15.4
COFT
Backbone=LLaMA-2-13B
2026.05
15.4
SDD
Backbone=LLaMA-2-13B
2026.05
15.6
DExperts
Backbone=LLaMA-2-13B
2026.05
15.8
Feedback
Search any
task
Search any
task
