Share your thoughts, 1 month free Claude Pro on usSee more

Key-value Retrieval on LITM (Lost in the Middle)

99.9Accuracy

xKV

Updated 2mo ago

Evaluation Results

Method	Links
xKV 2025.11		99.9
kvtc8× 2025.11		99.9
Vanilla 2025.11		99.8
FP8 2025.11		99.8
kvtc16× 2025.11		99.8
xKV 2025.11		99.6
kvtc32× 2025.11		99.6
Vanilla 2025.11		99.5
Vanilla 2025.11		99.4
FP8 2025.11		99.4
kvtc8× 2025.11		99.4
kvtc8× 2025.11		99.3
kvtc16× 2025.11		99.3
kvtc16× 2025.11		99.3
kvtc32× 2025.11		99.1
FP8 2025.11		99
xKV 2025.11		97.9
GEAR2-bit 2025.11		96.9
GEAR2-bit 2025.11		96.9
GEAR2-bit 2025.11		96
kvtc64× 2025.11		95.3
KIVI2-bit 2025.11		91.9
kvtc64× 2025.11		90.2
KIVI2-bit 2025.11		88.8
kvtc32× 2025.11		86.9
KIVI2-bit 2025.11		86.3
kvtc64× 2025.11		59.5
H2O 2025.11		20.2
H2O 2025.11		16.6
H2O 2025.11		16.2
TOVA 2025.11		8.7
TOVA 2025.11		1.2
TOVA 2025.11		0.3