Next-token prediction on Wikipedia English (test)
640Bits per Token (BPT)
ASTRA
Updated 6d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2025.05 | 640 | 7.7336 | 1,638.4 | |
2025.05 | 10,240 | 7.5879 | 102.4 | |
2025.05 | 20,480 | 7.436 | 51.2 | |
2025.05 | 1,048,576 | 5.8118 | - |
ASTRA
| Method | Links | |||
|---|---|---|---|---|
2025.05 | 640 | 7.7336 | 1,638.4 | |
2025.05 | 10,240 | 7.5879 | 102.4 | |
2025.05 | 20,480 | 7.436 | 51.2 | |
2025.05 | 1,048,576 | 5.8118 | - |