Share your thoughts, 1 month free Claude Pro on usSee more

Reasoning on MMLU-Pro (Subject Averages)

55Average Score

RAT

Updated 22d ago

Evaluation Results

Method
RAT 2025.08	55	57.5	55.3	73	34.2
CoT 2025.08	54.5	56.7	53.1	70.4	38.2
Standard RAG 2025.08	53.5	57	52.3	68.6	36.2
Search-o1 2025.08	53.5	53.5	55.3	69.8	35.4
UR2 (GPT Summary) 2025.08	53.3	53.2	53	72.2	35
Self-Ask 2025.08	51	56.3	48.5	67.8	31.2
UR2 (qw Summary) 2025.08	50.3	51.2	49.7	67.8	32.6
Open-Reasoner-Zero 2025.08	49.6	50	46.6	67.5	34.2
Vanilla RL 2025.08	48.4	52.2	43.5	64	33.8
UR2 (GPT summary) 2025.08	47.8	47.8	49.3	63.9	30
UR2 2025.08	47.8	47.8	49.3	63.9	30
General Reasoner 2025.08	47.1	47.9	44.2	65.9	30.4
RAT 2025.08	46.6	47.2	44.7	64.4	30
Search-o1 2025.08	45.4	42.8	45.9	63.2	29.6
NeuFS 2026.07	45.2	-	-	-	-
CoT 2025.08	44.5	42.3	45.7	63.4	26.6
TypiClust (S.) 2026.07	43.7	-	-	-	-
UR2 (GPT summary) 2025.08	43.4	48.3	38.6	58	28.8
UR2 2025.08	43.4	48.3	38.6	58	28.8
UR2 (qw summary) 2025.08	43.2	43	42.6	60.6	26.6
Entropy (Highest) 2026.07	43	-	-	-	-
Standard RAG 2025.08	42.4	44.6	41.1	57.8	26
UR2 (qw summary) 2025.08	42.4	43.6	41.2	56.8	28
Self-Ask 2025.08	42.3	40.7	42.1	60	26.2
FastVoteK (S.+L.) 2026.07	42	-	-	-	-
Entropy (Diverse) 2026.07	41.4	-	-	-	-
Random 2026.07	41.2	-	-	-	-
CoT 2025.08	40.3	37.8	40.9	53.4	29
CoT 2025.08	40.3	37.8	40.9	53.4	29
RAT 2025.08	40.3	42.3	37.7	52.6	28.6
Vanilla RL 2025.08	40.2	44.6	36.9	53	26.4
Vanilla RL 2025.08	40.2	44.6	36.9	53	26.4
FastVoteK (L.) 2026.07	40.1	-	-	-	-
VoteK (S.+E.) 2026.07	40.1	-	-	-	-
TypiClust (S.+L.) 2026.07	39.8	-	-	-	-
Patron 2026.07	39.1	-	-	-	-
Standard RAG 2025.08	38.8	43.6	33.9	51	26.6
Standard RAG 2025.08	38.8	43.6	33.9	51	26.6
Vanilla RL 2025.08	38.7	40.7	34.7	55	24.6
Vanilla RL 2025.08	38.7	40.7	34.7	55	24.6
FastVoteK (S.) 2026.07	38.6	-	-	-	-
SimpleRL-Zoo 2025.08	38.3	35.7	36.9	55.2	25.4
TypiClust (L.) 2026.07	37.6	-	-	-	-
VoteK (S.+E.+L.) 2026.07	37.4	-	-	-	-
Standard RAG 2025.08	37.1	37.8	36.5	51.4	23.2
Standard RAG 2025.08	37.1	37.8	36.5	51.4	23.2
Self-Ask 2025.08	35.6	39.8	32.1	47	23.4
RAT 2025.08	35.1	37.8	33.5	50.6	18.4
Search-o1 2025.08	34.9	33.9	34.5	50.6	20.6
Search-o1 2025.08	34.8	32.6	32.5	46	28
CoT 2025.08	33.8	33.6	32.3	48.8	20.6
CoT 2025.08	33.8	33.6	32.3	48.8	20.6
Self-Ask 2025.08	32	33.1	30.5	44.2	20.2
NeuFS 2026.07	25.1	-	-	-	-
Random 2026.07	24.9	-	-	-	-
TypiClust (L.) 2026.07	24.8	-	-	-	-
VoteK (S.+E.) 2026.07	24.6	-	-	-	-
Entropy (Highest) 2026.07	24.5	-	-	-	-
FastVoteK (S.) 2026.07	24.5	-	-	-	-
Patron 2026.07	24.4	-	-	-	-
Entropy (Diverse) 2026.07	24.4	-	-	-	-
TypiClust (S.+L.) 2026.07	24.3	-	-	-	-
TypiClust (S.) 2026.07	24.2	-	-	-	-
FastVoteK (L.) 2026.07	24.2	-	-	-	-
FastVoteK (S.+L.) 2026.07	24.2	-	-	-	-
VoteK (S.+E.+L.) 2026.07	23.3	-	-	-	-