Share your thoughts, 1 month free Claude Pro on usSee more

Knowledge Reasoning on MMLU-Pro

91.43Accuracy

SIGMA

Updated 1mo ago

Evaluation Results

Method
SIGMA 2026.05	91.43	93.91	-	-	-	-
G-Designer 2026.05	90.54	93.22	-	-	-	-
GoA 2026.05	90.24	92.86	-	-	-	-
GPTSwarm 2026.05	90.12	92.39	-	-	-	-
ComplexCoT 2026.05	86.45	91.01	-	-	-	-
CoT 2026.05	85.72	90.68	-	-	-	-
In-place 2025.10	83.4	-	-	-	-	-
In-place 2025.10	81.7	-	-	-	-	-
Memory 2025.10	81.4	-	-	-	-	-
In-place 2025.10	81.3	-	-	-	-	-
MoA 2026.05	80.76	89.83	-	-	-	-
Multi-turn 2025.10	80.5	-	-	-	-	-
Memory 2025.10	80.3	-	-	-	-	-
Memory 2025.10	80.2	-	-	-	-	-
Qwen3 2026.04	80.1	-	-	-	-	-
Qwen3-32B 2026.06	80.03	-	-	-	-	-
Qwen3-32B 2026.06	79.72	-	-	-	-	2.42
I-DLM 2026.04	79.7	-	-	-	-	-
LLaMA-70B 2026.06	79.4	-	-	-	-	-
Multi-turn 2025.10	79.3	-	-	-	-	-
In-place 2025.10	79.3	-	-	-	-	-
LLaMA-70B 2026.06	79.15	-	-	-	-	3.27
In-place 2025.10	79.1	-	-	-	-	-
Memory 2025.10	78.7	-	-	-	-	-
Memory 2025.10	78.5	-	-	-	-	-
Multi-turn 2025.10	77.9	-	-	-	-	-
Qwen3-32B 2026.06	77.83	-	-	-	-	-
Qwen3-32B 2026.06	77.83	-	-	-	-	-
Qwen3-14B 2026.06	77.79	-	-	-	-	5.77
In-place 2025.10	77.7	-	-	-	-	-
Qwen2.5-32B-Instruct + Bootcamp-SFT-RL 2025.08	77.1	-	-	-	-	-
Multi-turn 2025.10	77.1	-	-	-	-	-
LLaMA-70B 2026.06	76.64	-	-	-	-	-
LLaMA-70B 2026.06	76.64	-	-	-	-	-
LLaDA-2.1-flash 2026.04	76.6	-	-	-	-	-
Qwen3-14B 2026.06	76.57	-	-	-	-	-
Memory 2025.10	76.5	-	-	-	-	-
Multi-turn 2025.10	76.3	-	-	-	-	-
SCOPE-RL 2025.10	76.1	-	-	-	-	-
Qwen2.5-32B-Instruct + Bootcamp-SFT 2025.08	76.1	-	-	-	-	-
Vanilla 2026.05	75.71	87.69	-	-	-	-
KL-cov 2025.10	75.5	-	-	-	-	-
Multi-turn 2025.10	75.3	-	-	-	-	-
Qwen3-8B 2026.06	75.24	-	-	-	-	5.94
Qwen3 2026.04	75.1	-	-	-	-	-
CISPO 2025.10	75.1	-	-	-	-	-
DAPO 2025.10	75	-	-	-	-	-
LLaDA-2.0-flash 2026.04	74.8	-	-	-	-	-
Entropy-Adv 2025.10	74.8	-	-	-	-	-
Memory 2025.10	74.6	-	-	-	-	-
In-place 2025.10	74.4	-	-	-	-	-
Qwen3-8B 2026.06	74.21	-	-	-	-	-
GRPO 2025.10	74.1	-	-	-	-	-
Entropy-Reg 2025.10	73.7	-	-	-	-	-
Qwen3-14B 2026.06	73.56	-	-	-	-	-
Qwen3-14B 2026.06	73.56	-	-	-	-	-
Multi-turn 2025.10	73.4	-	-	-	-	-
I-DLM 2026.04	73.1	-	-	-	-	-
DS-R1-Distilled-Qwen-32B 2025.08	73	-	-	-	-	-
Base 2025.10	72.6	-	-	-	-	-
Qwen3-4B 2026.06	71.66	-	-	-	-	5.5
Qwen3-4B 2026.06	71.15	-	-	-	-	-
Qwen3-8B 2026.06	71.11	-	-	-	-	-
Qwen3-8B 2026.06	71.11	-	-	-	-	-
DS-R1-Distilled-Qwen-32B + Bootcamp-RL 2025.08	70.6	-	-	-	-	-
In-place 2025.10	70.6	-	-	-	-	-
Multi-turn 2025.10	70.2	-	-	-	-	-
Qwen2.5-32B-Instruct 2025.08	69.1	-	-	-	-	-
Memory 2025.10	68.8	-	-	-	-	-
Qwen2.5-32B-Instruct + Bootcamp-RL 2025.08	68.3	-	-	-	-	-
Qwen3-4B 2026.06	67.92	-	-	-	-	-
Qwen3-4B 2026.06	67.92	-	-	-	-	-
LLaDA-2.1-mini 2026.04	64.8	-	-	-	-	-
SDPO 2026.02	63.3	-	-	-	-	-
Qwen3-8B 2026.02	62.5	-	-	-	-	-
SDAR 2026.04	61.5	-	-	-	-	-
Multi-turn 2025.10	61.3	-	-	-	-	-
Memory 2025.10	61.3	-	-	-	-	-
In-place 2025.10	61.3	-	-	-	-	-
LOVER (sum) 2026.05	61.24	-	-	-	-	-
Supervised 2026.05	61.13	-	-	-	-	-
SCOPE-RL 2025.10	60.7	-	-	-	-	-
LLaMA-8B 2026.06	60.67	-	-	-	-	-
LLaMA-8B 2026.06	60.47	-	-	-	-	2.03
DAPO 2025.10	59.8	-	-	-	-	-
LOVER (max) 2026.05	59.28	-	-	-	-	-
LLaMA-8B 2026.06	59.27	-	-	-	-	-
LLaMA-8B 2026.06	59.27	-	-	-	-	-
KL-cov 2025.10	59.1	-	-	-	-	-
CoT-Decoding (sum) 2026.05	58.81	-	-	-	-	-
Qwen3-1.7B 2026.06	58.63	-	-	-	-	4.82
Qwen3-1.7B 2026.06	58.49	-	-	-	-	-
GRPO 2025.10	58.2	-	-	-	-	-
Entropy-Reg 2025.10	58.2	-	-	-	-	-
Qwen3-4B 2026.02	58.1	-	-	-	-	-
SDPO 2026.02	58	-	-	-	-	-
CISPO 2025.10	57.8	-	-	-	-	-
Entropy-Adv 2025.10	57.7	-	-	-	-	-
Majority Voting 2026.05	57	-	-	-	-	-
SDAR 2026.04	56.9	-	-	-	-	-

Showing 100 of 246 rows