| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| Synthetic Poisson Process Requests | FlashSampling | TPOT Speedup (%)18.7 | 28 | 1mo ago | |
| LLaMA-3 8B | MXFP4 | TTFT (ms)56.03 | 12 | 1mo ago | |
| Context Length 200K | IndexCache | Prefill Time (s)10.7 | 3 | 1mo ago | |
| Context Length 120K | IndexCache | Prefill Time (s)5.66 | 3 | 1mo ago | |
| Context Length 60K | IndexCache | Prefill Time (s)2.59 | 3 | 1mo ago | |
| Context Length 10K | IndexCache | Prefill Time (s)0.45 | 3 | 1mo ago |
