LLM Inference Performance on Context Length 60K
2.59Prefill Time (s)
IndexCache
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.03 | 2.59 | 89.5 | 840 | |
2026.03 | 2.86 | 80 | 750 | |
2026.03 | 3.38 | 67 | 613 |
IndexCache
| Method | Links | |||
|---|---|---|---|---|
2026.03 | 2.59 | 89.5 | 840 | |
2026.03 | 2.86 | 80 | 750 | |
2026.03 | 3.38 | 67 | 613 |