Trace-driven simulation
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| KV Cache Efficiency | Trace-driven simulation No-limit KV cache budget 100k-doc pool Zipf doc popularity | Hit Ratio (Low Skewness)21.33 | 4 | |
| KV Cache Efficiency | Trace-driven simulation 50 GB KV cache budget 100k-doc pool Zipf doc popularity | Hit Ratio (Low Skewness)20.22 | 4 | |
| KV Cache Efficiency | Trace-driven simulation 10 GB KV cache budget 100k-doc pool Zipf doc popularity | Low Skewness Hit Ratio13.78 | 4 | |
| KV Cache Efficiency | Trace-driven simulation 5 GB KV cache budget 100k-doc pool Zipf doc popularity | Hit Ratio (Low Skewness)10.85 | 4 | |
| KV Cache Efficiency | Trace-driven simulation 1 GB KV cache budget 100k-doc pool Zipf doc popularity | Low Skewness Hit Ratio3.47 | 4 |
Showing 5 of 5 rows