| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| Long sequence prompts | FedRAG | TTFT (s)1.05 | 24 | 8d ago | |
| Sequence prompts Medium | FedRAG | TTFT (s)0.37 | 24 | 8d ago | |
| Short sequence prompts | FedRAG | TTFT (s)0.2 | 24 | 8d ago | |
| AIME | RelayCaching | Time To First Token (TTFT)40.6 | 12 | 2mo ago | |
| Instruction-in-Wild self-instructed prompts 36 | Throughput (samples/s)2.52 | 7 | 3mo ago | ||
| LongBench-E | Prefill Time (sec)3.032 | 5 | 2mo ago | ||
| Edge Device | RAP | Latency (s)43.36 | 4 | 15d ago | |
| Synthetic LLM Workload Input 4096 Output 4096 | ChunkKV | Latency (s)160.32 | 4 | 23d ago | |
| HumanEval | ReMoE | TTFT (ms)5,233.11 | 2 | 7d ago | |
| Synthetic LLM Workload Input 8192 Output 4096 | ShotKV | Latency (s)162.78 | 2 | 23d ago | |
| Self-instructed prompts (test) | - | Throughput (samples/s)- | 0 | 3mo ago |
