Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Language Modeling on Private-domain fusion set medical, legal, and patent
Loading...
2.418
EW Loss
KALAVAI (MoE)
2.39656
2.54128
2.686
2.83072
Mar 24, 2026
EW Loss
Improvement vs. Best Spec.
Improvement vs. Monolithic
Standard Deviation (pp)
Updated 24d ago
Evaluation Results
Method
Method
Links
EW Loss
Improvement vs. Best Spec.
Improvement vs. Monolithic
Standard Deviation (pp)
KALAVAI (MoE)
Scale=Pythia-410M, See...
2026.03
2.418
0.1017
0.0178
0.0015
Monolithic (6k)
Scale=Pythia-410M, See...
2026.03
2.462
-
-
-
Best specialist
Scale=Pythia-410M, See...
2026.03
2.694
-
-
-
Weight avg.
Scale=Pythia-410M
2026.03
2.709
-
-
-
Base model
Scale=Pythia-410M
2026.03
2.954
-
-
-
Feedback
Search any
task
Search any
task