Sparse Decoding (GQA) on Synthetic 128K context (test)
0.19FlashInfer Latency (ms)
FlashInfer
Updated 8d ago
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
2026.05 | 0.19 | - | - | - | - | - | - | |
2026.05 | 0.72 | - | - | - | - | - | - | |
2026.05 | 1.5 | - | - | - | - | - | - | |
2026.05 | 3.08 | - | - | - | - | - | - | |
| - | 0.28 | 0.56 | 0.83 | 1.12 | 1.46 | 1.65 | ||
| - | 0.32 | 0.67 | 1.06 | 1.52 | 2.11 | 2.45 | ||
| - | 0.36 | 0.75 | 1.18 | 1.68 | 2.3 | 2.66 | ||
| - | 0.41 | 0.85 | 1.31 | 1.82 | 2.46 | 2.81 |