Transformer Inference on 12-layer Transformer 1024 tokens
342.74Speedup
ASTRA
Updated 6d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2025.05 | 342.74 | |
2025.05 | 177.89 | |
2025.05 | 171.82 | |
2025.05 | 89.41 | |
2025.05 | 73.14 | |
2025.05 | 37.19 | |
2025.05 | 37.05 | |
2025.05 | 29.37 | |
2025.05 | 19.08 | |
2025.05 | 19.02 | |
2025.05 | 15.66 | |
2025.05 | 15.25 | |
2025.05 | 9.99 | |
2025.05 | 8.41 | |
2025.05 | 8.05 | |
2025.05 | 6.95 | |
2025.05 | 4.51 | |
2025.05 | 4.07 | |
2025.05 | 3.96 | |
2025.05 | 2.58 | |
2025.05 | 2.45 | |
2025.05 | 1.83 | |
2025.05 | 1.53 | |
2025.05 | 1.37 |