Share your thoughts, 1 month free Claude Pro on usSee more

Complex Reasoning on BBH

90.5Accuracy

DECENTMEM

Updated 1mo ago

Evaluation Results

Method	Links
DECENTMEM 2026.05		90.5
G-Memory 2026.05		89.2
Qwen3-32B 2026.06		88.61
Qwen3-14B 2026.06		88.38
Qwen3-4B 2026.06		87.18
LLaMA-70B 2026.06		86.42
Base 2025.05		85.93
Qwen3-8B 2026.06		85.87
Qwen3-32B 2026.06		85.79
Qwen3-14B 2026.06		85.33
DECENTMEM 2026.05		85.07
LLaMA-70B 2026.06		84.81
Qwen3-4B 2026.06		84.78
Qwen3-8B 2026.06		84.67
DECENTMEM 2026.05		84.3
G-Memory 2026.05		82.09
MetaGPT 2026.05		81.68
ChatDev 2026.05		79.28
DECENTMEM 2026.05		76.19
MetaGPT 2026.05		76.12
RCE 2026.02		76.1
Qwen3-1.7B 2026.06		74.55
Qwen3-1.7B 2026.06		72.83
DECENTMEM 2026.05		72.43
RCE 2026.02		72.3
ChatDev 2026.05		71.14
LLaMA-8B 2026.06		70.9
RCE 2026.02		70.5
LLaMA-8B 2026.06		70.48
MetaGPT 2026.05		68.86
G-Memory 2026.05		68.52
No memory 2026.05		67.33
G-Memory 2026.05		66.84
DECENTMEM 2026.05		65.52
MetaGPT 2026.05		65.48
ChatDev 2026.05		65.28
DisCO 2026.02		64.8
Vanilla LoRA 2025.05		64.58
DECENTMEM 2026.05		63.8
Base 2026.02		63.5
SHE-LoRA 2025.05		63.26
G-Memory 2026.05		62.18
GRPO 2026.02		62.1
No memory 2026.05		61.88
MetaGPT 2026.05		61.58
G-Memory 2026.05		61.53
Qwen3 8B 2026.02		60.86
No memory 2026.05		60.52
SC 2026.02		60.2
ChatDev 2026.05		59.61
ToT 2026.02		59.5
DECENTMEM 2026.05		59.43
G-Memory 2026.05		58.62
CoT 2026.02		57.8
MetaGPT 2026.05		57.14
Base 2026.02		54.7
No memory 2026.05		54.68
MetaGPT 2026.05		54.19
ChatDev 2026.05		53.37
DECENTMEM 2026.05		52.19
Base 2026.02		51.3
ROCKET 2026.02		50.33
ChatDev 2026.05		48.92
ShapLoRA 2026.01		48.7
G-Memory 2026.05		48.14
MOELoRA 2026.01		47.8
AutoLoRA 2026.01		47.6
ROCKET 2026.02		47.54
CoSpaDi 2026.02		45.25
MetaGPT 2026.05		45.23
ChatDev 2026.05		44.73
No memory 2026.05		44.43
G-Memory 2026.05		43.97
No memory 2026.05		42.61
ChatDev 2026.05		42.11
No memory 2026.05		41.17
SVD-LLM 2026.02		41
MetaGPT 2026.05		40.86
InfLLM v2 2026.01		40.55
ROCKET 2026.02		40.06
Dense 2026.01		40.02
InfLLM v2 2026.01		40.02
InfLLM v2 2026.01		39.78
PHSA 2026.01		39.56
CoSpaDi 2026.02		38.22
No memory 2026.05		35.13
SVD-LLM 2026.02		34.42
Dense 2026.01		33.99
ChatDev 2026.05		33.67
PHSA 2026.01		33.37
PHSA 2026.01		32.78
CoSpaDi 2026.02		32.72
PHSA 2026.01		32.11
SVD-LLM 2026.02		30.24
No memory 2026.05		28.13
InfLLM v2 2026.01		26.26
Base 2025.05		10.85
Vanilla LoRA 2025.05		9.38
SHE-LoRA 2025.05		9.26