Language Modeling on 1 Billion Word Benchmark 1.0 (test)
28Test Perplexity (10 epochs)
High-Budget MoE Model
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2017.01 | 28 | - | |
2017.01 | 31.3 | - | |
2017.01 | 34.1 | - | |
| 34.7 | 30.6 |
High-Budget MoE Model
| Method | Links | ||
|---|---|---|---|
2017.01 | 28 | - | |
2017.01 | 31.3 | - | |
2017.01 | 34.1 | - | |
| 34.7 | 30.6 |