Our new X account is live! Follow @wizwand_team for updates

Long-context understanding on RULER

94.45Score

Qwen2.5-7B

Updated 4d ago

Evaluation Results

Method	Links
Qwen2.5-7B 2025.12		94.45
Gemini-1.5-Pro 2024.08		94.4
GA-S2 2025.12		91.1
SMART 2025.12		89.49
Qwen2.5-1.5B 2025.12		87.42
GA-S2 2025.12		85.84
SMART 2025.12		81.58
GPT-4 2024.08		81.2
GLM4-9B-Chat-1M 2024.08		79.9
Gradient-Llama3-8B 2024.08		78.4
Llama3.1-8B-Instruct 2024.08		77.7
Yi-34B-200k 2024.08		77.3
LongRecipe 2024.08		76
FLT 2024.08		75.8
FLT 2024.08		75.7
POSE 2024.08		75.3
LongRecipe 2024.08		74.5
Gradient-Llama3-70B 2024.08		72.1
RPES 2024.08		71.5
RPES 2024.08		71.4
LongRecipe 2024.08		70.8
POSE 2024.08		69.9
Llama3.1-8B 2024.08		69.8
GA-S2 2025.12		69.53
FLT* 2024.08		69.5
RPES 2024.08		68.9
LongRecipe 2024.08		67.2
POSE 2024.08		66.7
Llama3.1-70B-Instruct 2024.08		66.6
RPES 2024.08		65.1
POSE 2024.08		65
LongRecipe 2024.08		64.8
SMART 2025.12		64.79
RPES 2024.08		64.6
Yi-9B-200k 2024.08		62.3
POSE 2024.08		60.1
LongRecipe 2024.08		58.2
FLT 2024.08		57.4
GA-S2 2025.12		54.08
Qwen2-72B-Instruct 2024.08		53.7
RPES 2024.08		52.5
Qwen2-7B-Instruct 2024.08		52.5
FLT* 2024.08		51.3
SMART 2025.12		50.98
POSE 2024.08		46.3