Inference Efficiency on Qwen2.5-7B
1,480.2Throughput (tokens/s)
AWQ
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.02 | 1,480.2 | 0.675 | - | |
2026.02 | 1,093.1 | 0.915 | - | |
2026.02 | 1,035.4 | 0.966 | - | |
2026.02 | 929.4 | 1.0759 | - | |
2026.03 | 27.3 | - | 178.3 | |
2026.03 | 25.6 | - | 84.8 | |
2026.03 | 24 | - | 78.5 | |
2026.03 | 18.9 | - | 137.8 | |
2026.03 | 0.2 | - | 50,245.9 |