Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
KV Cache Footprint Analysis on Context Length 32K (test)
Loading...
1,863.6
Effective b_KV (dense)
Spherical KV
1,850.48
1,939.04
2,027.6
2,116.16
May 13, 2026
Effective b_KV (dense)
Effective b_KV (spherical)
KV Reduction (%)
Peak KV (GB) (dense)
Peak KV (GB) (spherical)
Updated 14d ago
Evaluation Results
Method
Method
Links
Effective b_KV (dense)
Effective b_KV (spherical)
KV Reduction (%)
Peak KV (GB) (dense)
Peak KV (GB) (spherical)
Spherical KV
Model=Llama-3.1-8B, Co...
2026.05
1,863.6
1,256.6
32.6
0.06
0.04
Spherical KV
Model=GPT-oss, Context...
2026.05
1,927.5
1,329.8
31
0.062
0.043
Spherical KV
Model=Qwen2.5-14B, Con...
2026.05
2,191.6
1,413.4
35.5
0.07
0.045
Feedback
Search any
task
Search any
task