SOTA Social Commonsense Reasoning on SocialIQA and PapersWithCode

87.11Accuracy

Hard-routing MoE

Updated 4d ago

Evaluation Results

Method
Hard-routing MoE 2026.02	87.11	-
Sparse-and-Orthogonal LoRA 2026.02	85.52	-
FPFT 2026.02	83.96	-
Sparse-and-Orthogonal LoRA (Single) 2026.02	83.74	-
LoRI 2026.02	83.4	-
Hard-routing MoE 2026.02	83.04	-
LoRA 2026.02	80.99	-
Qwen3 14B Base 2026.01	79.9	-
Qwen3 14B Base 2026.01	79.8	-
Sparse-and-Orthogonal LoRA 2026.02	79.49	-
Mistral Small 24B Inst 2501 2026.01	79.2	20
Mistral Small 24B Inst 2501 2026.01	79.2	20
LoRA 2026.02	79.2	-
FPFT 2026.02	79.16	-
Qwen3 8B Base 2026.01	78.8	20
Qwen3 8B Base 2026.01	78.8	20
Qwen3 8B Base 2026.01	78.8	-
Qwen3 8B Base 2026.01	78.8	-
LoRI 2026.02	78.64	-
Sparse-and-Orthogonal LoRA (Single) 2026.02	78.38	-
Qwen3 14B 2026.01	75.9	-
Qwen3 8B 2026.01	75.8	-
Qwen3 8B 2026.01	75.8	-
Qwen3 14B 2026.01	75.8	-
Qwen3 4B Base 2026.01	74	-
Qwen3 4B Base 2026.01	74	-
Mistral Nemo Inst 2407 2026.01	73.4	-10
Mistral Nemo Inst 2407 2026.01	73.4	-10
Qwen3 4B 2026.01	72.2	-
Qwen3 4B 2026.01	72.2	-
Llama 3.1 8B Inst 2026.01	70.7	0
Llama 3.1 8B Inst 2026.01	70.6	-20
Mistral Small 24B Base 2501 2026.01	70.2	20
Mistral Small 24B Base 2501 2026.01	70.2	20
Qwen3 1.7B Base 2026.01	69.4	-
Qwen3 1.7B Base 2026.01	69.4	-
Mistral 7B Inst v0.3 2026.01	68.9	30
Mistral 7B Inst v0.3 2026.01	68.9	30
Llama 3.2 3B Inst 2026.01	68.1	40
Llama 3.2 3B Inst 2026.01	68	30
Mistral Nemo Base 2407 2026.01	64.9	10
Mistral Nemo Base 2407 2026.01	64.9	10
Mistral Nemo Base 2407 2026.01	64.7	-20
Mistral Nemo Base 2407 2026.01	64.7	-20
Llama 3.1 8B 2026.01	62.7	0
Llama 3.1 8B 2026.01	62.7	0
Llama 3.1 8B 2026.01	62.6	-10
Llama 3.1 8B 2026.01	62.6	-10
Qwen3 1.7B 2026.01	62.5	-
Qwen3 1.7B 2026.01	62.5	-
Mistral 7B v0.3 2026.01	61.1	-10
Mistral 7B v0.3 2026.01	61.1	-10
Mistral 7B v0.3 2026.01	60.8	-30
Mistral 7B v0.3 2026.01	60.8	-30
Llama 3.2 3B 2026.01	59.9	10
Llama 3.2 3B 2026.01	59.9	20
Qwen3 0.6B Base 2026.01	58	-
Qwen3 0.6B Base 2026.01	57.9	-
Llama 3.2 1B Inst 2026.01	55.4	40
Llama 3.2 1B Inst 2026.01	55.1	10
Qwen3 0.6B 2026.01	52	-30
Qwen3 0.6B 2026.01	52	-30
Qwen3 0.6B 2026.01	52	-
Qwen3 0.6B 2026.01	52	-
Llama 3.2 1B 2026.01	48.5	50
Llama 3.2 1B 2026.01	48.5	50
Llama 3.2 1B 2026.01	48.1	10
Llama 3.2 1B 2026.01	48.1	10