LLM Inference Performance on Context Length 10K
0.45Prefill Time (s)
IndexCache
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.03 | 0.45 | 91 | 3,310 | |
2026.03 | 0.47 | 84.5 | 3,070 | |
2026.03 | 0.57 | 73.5 | 2,700 |
IndexCache
| Method | Links | |||
|---|---|---|---|---|
2026.03 | 0.45 | 91 | 3,310 | |
2026.03 | 0.47 | 84.5 | 3,070 | |
2026.03 | 0.57 | 73.5 | 2,700 |