Constrained LLM Decoding on Qwen2-14B INT8
16.52Inference Time (ms)
Pre³
Updated 4d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2025.06 | 16.52 | 1.52 | |
2025.06 | 16.77 | - | |
2025.06 | 43.09 | 10.12 | |
2025.06 | 47.94 | - | |
2025.06 | 49.99 | 12.37 | |
2025.06 | 57.05 | - | |
2025.06 | 65.5 | 12.14 | |
2025.06 | 74.54 | - | |
2025.06 | 80.34 | 18.55 | |
2025.06 | 98.64 | - | |
2025.06 | 143.83 | 11.47 | |
2025.06 | 162.47 | - | |
2025.06 | 232.18 | 18.65 | |
2025.06 | 285.42 | - |