Inference Efficiency on 30k Context Length Llama-2-7B
6.6Inference Throughput (QPS)
Finetuning
Updated 3d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2025.03 | 6.6 | - | - | - | |
2025.03 | 3.4 | - | - | - | |
2025.03 | 1.5 | - | - | - | |
2025.03 | 0.8 | - | - | - | |
2025.03 | - | - | 1 | 1 | |
2025.03 | - | - | 4.5 | 0.51 | |
2025.03 | - | - | - | 0.12 | |
2025.03 | - | - | 3 | 0.22 |