Share your thoughts, 1 month free Claude Pro on usSee more

Needle Retrieval on Needle In A Haystack

67Exact-match Accuracy

KV-CAT

Updated 2mo ago

Evaluation Results

Method	Links
KV-CAT 2026.05		67
KV-CAT 2026.05		55
KV-CAT 2026.05		54
QWEN2.5-1.5B 2026.05		49
KV-CAT 2026.05		47
QWEN2.5-1.5B 2026.05		46
KV-CAT 2026.05		44
QWEN2.5-1.5B 2026.05		42
QWEN2.5-1.5B 2026.05		41
KV-CAT 2026.05		38
KV-CAT 2026.05		36.9
KV-CAT 2026.05		34
KV-CAT 2026.05		32
QWEN2.5-1.5B 2026.05		31.7
QWEN2.5-0.5B 2026.05		28
KV-CAT 2026.05		28
KV-CAT 2026.05		26
QWEN2.5-0.5B 2026.05		24
QWEN2.5-1.5B 2026.05		24
QWEN2.5-0.5B 2026.05		23
KV-CAT 2026.05		23
KV-CAT 2026.05		22
QWEN2.5-1.5B 2026.05		22
QWEN2.5-0.5B 2026.05		21
QWEN2.5-1.5B 2026.05		21
KV-CAT 2026.05		21
QWEN2.5-0.5B 2026.05		20
QWEN2.5-1.5B 2026.05		20
QWEN2.5-1.5B 2026.05		20
KV-CAT 2026.05		20
KV-CAT 2026.05		20
QWEN2.5-0.5B 2026.05		19.6
QWEN2.5-0.5B 2026.05		18
KV-CAT 2026.05		17
KV-CAT 2026.05		16
QWEN2.5-0.5B 2026.05		15
QWEN2.5-0.5B 2026.05		15
KV-CAT 2026.05		15
KV-CAT 2026.05		13
QWEN2.5-0.5B 2026.05		12