Inference Efficiency on 30k Context Length (Llama-3.1-8B)
15.8Inference Throughput (QPS)
Finetuning
Updated 3d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2025.03 | 15.8 | - | |
2025.03 | 12.8 | - | |
2025.03 | 11.6 | - | |
2025.03 | 1.3 | - |
Finetuning
| Method | Links | ||
|---|---|---|---|
2025.03 | 15.8 | - | |
2025.03 | 12.8 | - | |
2025.03 | 11.6 | - | |
2025.03 | 1.3 | - |