Inference Efficiency on LLaMA2-7B (12/128 tokens)
1.889Latency
SWM (Ours)
Updated 29d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2025.02 | 1.889 | 67.77 | 8,725.9 | |
2025.02 | 1.938 | 66.048 | 8,725.9 | |
2025.02 | 2.084 | 61.433 | 8,725.85 | |
2025.02 | 2.339 | 54.758 | 10,682.45 | |
2025.02 | 2.529 | 50.622 | 10,682.45 | |
2025.02 | 2.585 | 49.542 | 10,682.45 | |
2025.02 | 2.729 | 46.905 | 13,020.25 | |
2025.02 | 4.045 | 31.656 | 10,707.25 | |
2025.02 | 4.127 | 31.051 | 8,855.95 | |
2025.02 | 4.619 | 27.726 | 8,901 | |
2025.02 | 4.628 | 27.663 | 10,676 | |
2025.02 | 5.63 | 22.736 | 9,043.9 | |
2025.02 | 5.655 | 22.635 | 10,951.5 |