Share your thoughts, 1 month free Claude Pro on usSee more

Multi-task Language Understanding on MMLU-Pro (pass@1)

92.85Pass@1

GT-Reward

Updated 4d ago

Evaluation Results

Method	Links
GT-Reward 2025.11		92.85
GT-Reward 2025.11		92.85
GT-Reward 2025.11		91.42
GT-Reward 2025.11		85.71
Self-Harmony 2025.11		77.68
Majority-Voting 2025.11		77.58
GT-Reward 2025.11		72.85
Rent 2025.11		69.91
Self-Harmony 2025.11		67.68
Rent 2025.11		66.16
Intuitor 2025.11		64.55
Qwen2.5-7B-Instruct 2025.08		63.65
Qwen2.5-7B-Instruct 2025.08		62.61
Llama3.1-8B-Instruct 2025.08		60.92
Intuitor 2025.11		60.54
Qwen2.5-7B-Instruct 2025.08		59.18
Qwen2.5-7B-Instruct 2025.08		58.98
SFT + GRPO 2026.01		57.8
Co-Reward 2025.11		57.59
GRPO 2026.01		57
Llama3.1-8B-Instruct 2025.08		56.58
SCR (Ours) 2026.01		56.3
Self-Refine 2026.01		55.9
Base 2026.01		55.8
Llama3.1-8B-Instruct 2025.08		54.39
Self-Harmony 2025.11		53.66
Majority-Voting 2025.11		52.95
Co-Reward 2025.11		51.79
SCR-Stage I 2026.01		51.5
Llama3.1-8B-Instruct 2025.08		50.29
Before RL 2025.11		50.09
Self-Harmony 2025.11		50
SCR-SFT 2026.01		49.1
Co-Reward 2025.11		47.14
GRPO 2026.01		45.5
Majority-Voting 2025.11		45.36
SFT + GRPO 2026.01		45.3
Majority-Voting 2025.11		44.82
GRPO 2026.01		44.6
SCR (Ours) 2026.01		44.5
Self-Harmony 2025.11		44.29
Before RL 2025.11		43.75
Self-Refine 2026.01		43.5
SCR (Ours) 2026.01		43.2
SFT + GRPO 2026.01		43
Co-Reward 2025.11		42.77
Base 2026.01		42.4
SCR-Stage I 2026.01		42.2
SCR-Stage I 2026.01		41.3
Rent 2025.11		40.8
Intuitor 2025.11		40
Base 2026.01		39.6
SCR-SFT 2026.01		39.1
SCR-SFT 2026.01		38.4
Intuitor 2025.11		34.64
Rent 2025.11		34.38
Before RL 2025.11		34.11
Co-Reward 2025.11		34.02
Majority-Voting 2025.11		31.43
Intuitor 2025.11		31.25
Before RL 2025.11		27.59
Rent 2025.11		18.04
Before RL 2025.11		16.61
Self-Refine 2026.01		9.9