Masked Language Modeling on BERT Pretraining Corpus
2.89Perplexity
gMLP_xlarge
Updated 4d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2021.05 | 2.89 | |
2021.05 | 3.19 | |
2021.05 | 3.32 | |
2021.05 | 3.35 | |
2021.05 | 3.95 | |
2021.05 | 4.17 | |
2021.05 | 4.28 |
gMLP_xlarge
| Method | Links | |
|---|---|---|
2021.05 | 2.89 | |
2021.05 | 3.19 | |
2021.05 | 3.32 | |
2021.05 | 3.35 | |
2021.05 | 3.95 | |
2021.05 | 4.17 | |
2021.05 | 4.28 |