Masked Language Modeling on Books, CC-News, Stories, Wikipedia (held-out set)
1.274BPC
BIGBIRD-ETC
Updated 4d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2020.07 | 1.274 | |
2020.07 | 1.358 | |
2020.07 | 1.456 | |
2020.07 | 1.496 | |
2020.07 | 1.611 | |
2020.07 | 1.678 | |
2020.07 | 1.705 | |
2020.07 | 1.846 |