Throughput Measurement on LLaMA-2 13B
19.4Throughput (tokens/s)
Token Filtering
Updated 1mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2025.12 | 19.4 | |
2025.12 | 19.4 | |
2025.12 | 19.2 | |
2025.12 | 19.1 | |
2025.12 | 17.8 | |
2025.12 | 17.2 | |
2025.12 | 16.8 | |
2025.12 | 16.1 | |
2025.12 | 15.4 | |
2025.12 | 14.9 | |
2025.12 | 14.6 | |
2025.12 | 11.8 | |
2025.12 | 9.6 | |
2025.12 | 8.8 | |
2025.12 | 7.5 | |
2025.12 | 5.8 | |
2025.12 | 5.2 | |
2025.12 | 4.7 | |
2025.12 | 4.4 | |
2025.12 | 2.7 |