Share your thoughts, 1 month free Claude Pro on usSee more

General Problem Solving on Mixed (AIME, GPQA, HLE, HotpotQA, ALFWorld)

57.74Average Score

UMEM-Qwen3-4B

Updated 1mo ago

Evaluation Results

Method	Links
UMEM-Qwen3-4B 2026.02		57.74
UMEM-Qwen3-4B 2026.02		55.47
Memp 2026.02		54.71
UMEM-Llama-3.2-1B 2026.02		53.6
Qwen3-4B-Instruct 2026.02		53.18
Self-RAG 2026.02		52.46
Memp 2026.02		52.29
Self-RAG 2026.02		51.95
UMEM-Llama-3.2-1B 2026.02		51.79
ReMem 2026.02		50.99
Qwen3-4B-Instruct 2026.02		50.9
UMEM-Qwen3-4B 2026.02		50.88
Llama-3.2-1B-Instruct 2026.02		50.34
UMEM-Llama-3.2-1B 2026.02		49.82
Llama-3.2-1B-Instruct 2026.02		49.75
ReMem 2026.02		49.49
No Memory 2026.02		49.14
Llama-3.2-1B-Instruct 2026.02		48.38
Memp 2026.02		47.32
No Memory 2026.02		47.28
Qwen3-4B-Instruct 2026.02		46.95
No Memory 2026.02		45.36
ReMem 2026.02		41.51
Self-RAG 2026.02		32.06