Next token prediction on OpenWebText
7.61BPD
GPT2 (124M)
Updated 4d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2024.07 | 7.61 | 0.7482 | 0.2698 | |
2024.07 | 8.5 | 0.7919 | 0.3272 | |
2024.07 | 10.47 | 0.895 | 0.4423 | |
2024.07 | 15.62 | 0.9999 | 0.998 |
GPT2 (124M)
| Method | Links | |||
|---|---|---|---|---|
2024.07 | 7.61 | 0.7482 | 0.2698 | |
2024.07 | 8.5 | 0.7919 | 0.3272 | |
2024.07 | 10.47 | 0.895 | 0.4423 | |
2024.07 | 15.62 | 0.9999 | 0.998 |