Share your thoughts, 1 month free Claude Pro on usSee more

Multi-needle retrieval on NIAH (M)

90.2Accuracy (NIAH M)

GLM4-9B-Chat-1M

Updated 1mo ago

Evaluation Results

Method	Links
GLM4-9B-Chat-1M 2024.08		90.2
Gradient-Llama3-8B 2024.08		89.6
Llama3.1-8B-Instruct 2024.08		89
Yi-34B-200k 2024.08		84.9
Qwen2-72B-Instruct 2024.08		83.4
LongRecipe 2024.08		82.6
FLT 2024.08		82.3
Gemini-1.5-Pro 2024.08		82
POSE 2024.08		80.1
LongRecipe 2024.08		79.5
Gradient-Llama3-70B 2024.08		79.2
LongRecipe 2024.08		78.9
GPT-4 2024.08		76.2
RPES 2024.08		73.7
FLT 2024.08		73.2
RPES 2024.08		72.7
Llama3.1-8B 2024.08		72
RPES 2024.08		71.8
POSE 2024.08		70
POSE 2024.08		68.8
Llama3.1-70B-Instruct 2024.08		68.3
LongRecipe 2024.08		65.8
Yi-9B-200k 2024.08		65.7
POSE 2024.08		64.7
LongRecipe 2024.08		64.7
FLT* 2024.08		64.7
RPES 2024.08		64.6
RPES 2024.08		60.4
POSE 2024.08		58.5
LongRecipe 2024.08		53.4
FLT* 2024.08		52.7
FLT 2024.08		43
RPES 2024.08		41.9
Qwen2-7B-Instruct 2024.08		38.8
POSE 2024.08		35.9