Share your thoughts, 1 month free Claude Pro on usSee more

Inference Efficiency on KV Cache Efficiency

1,966SKV Count

L2-7B (Base)

Updated 1mo ago

Evaluation Results

Method	Links
L2-7B (Base) 2025.07		1,966	-	668	-
KV-Latent Train (L2-7B) 2025.07		983	50	573	17
KV-Latent Distill (L2-7B) 2025.07		983	50	573	17
L3-8B (Base) 2025.07		491	-	670	-
KV-Latent Train (L3-8B) 2025.07		245	50	622	8
KV-Latent Distill (L3-8B) 2025.07		245	50	622	8
KV-Latent Train (L3-8B, d=16) 2025.07		64	87	595	13