Language Model Inference on stories100m 110M parameters
298.7Tokens/s
PyTorch (Accelerate)
Updated 4d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.01 | 298.7 | 3.3 | |
2026.01 | 61.3 | 16.3 | |
2026.01 | 24 | 41.6 |
PyTorch (Accelerate)
| Method | Links | ||
|---|---|---|---|
2026.01 | 298.7 | 3.3 | |
2026.01 | 61.3 | 16.3 | |
2026.01 | 24 | 41.6 |