Share your thoughts, 1 month free Claude Pro on usSee more

Question Answering on MMLU-Pro

89.1Accuracy

Reasoningbank

Updated 2d ago

Evaluation Results

Method	Links
Reasoningbank 2026.02		89.1
Reasoningbank+prompt 2026.02		87.9
No-Memory 2026.02		87.3
Reasoningbank+Guard 2026.02		87.2
TAME 2026.02		85.8
No-Memory 2026.02		81.6
TAME 2026.02		79.4
Reasoningbank 2026.02		79.1
Memento 2026.02		77.8
Reasoningbank+prompt 2026.02		76.8
Reasoningbank+Guard 2026.02		75
Memento 2026.02		74.2
DC 2026.02		70.1
DC 2026.02		68.7
DSRL (Ours) 2026.04		66.49
Base 2025.05		65.36
DSRL (Ours) 2026.04		63.79
GRPO 2026.04		61.12
Vanilla 2026.04		59.72
GRPO 2026.04		59.47
Vanilla 2026.04		58.61
LD-MoLE 2025.09		55.98
ReMoLE 2025.09		54.98
LD-MoLE 2025.09		53.82
ReMoLE 2025.09		53.4
MoLA(8888) 2025.09		51.12
MoLA(2468) 2025.09		50.37
Online DPO with ArmoRM 2026.02		50.3
MoLA(2468) 2025.09		49.96
LD-MoLE 2025.09		49.58
Online DPO with WILDREWARD 2026.02		48.9
Vanilla LoRA 2025.05		48.54
Offline DPO with WILDREWARD 2026.02		48.5
MoLA(8888) 2025.09		48.21
ReMoLE 2025.09		48.01
Llama3.1-8B-Instruct 2026.02		48
SHE-LoRA 2025.05		47.36
LLaMA-3-70B-Instruct 2025.06		46.36
RCO 2025.06		46.23
RCO 2025.06		43.01
MoLA(2468) 2025.09		42.31
RCO 2025.06		42.3
RCO 2025.06		40.89
RCO 2025.06		40.74
MoLA(8888) 2025.09		40.31
LLaMA-3-8B-Instruct 2025.06		37.88
LLAMA-2-70B-Chat 2025.06		37.59
DPCO 2025.06		37.22
DPCO 2025.06		36.69
DPCO 2025.06		36.52
DPCO 2025.06		36.21
DPCO 2025.06		35.98
Self-refinement 2025.06		35.49
LLaMA-2-7B-Chat 2025.06		35.29
LLaMA-2-13B-Chat 2025.06		34.93
UltraCM-13B 2025.06		33.73
Initial Answer 2025.06		33.14
Aligner 2025.06		32.39
Auto-J-13B 2025.06		28.65
SHE-LoRA 2025.05		14.86
Vanilla LoRA 2025.05		14.62
Base 2025.05		14.29