Share your thoughts, 1 month free Claude Pro on usSee more

Reward Modeling on RewardBench v2

92.1Accuracy

DeepSeek-V3.2

Updated 1mo ago

Evaluation Results

Method
DeepSeek-V3.2 2026.03	92.1	-
Gemini-3-Flash 2026.03	91.1	-
OpenRS 2026.02	90.7	89.4
Skywork-Reward-V2-Llama-3.1-8B-40M 2025.07	86.5	-
OpenRS 2026.02	85.8	86.7
OpenRS 2026.02	85.7	86.8
OpenRS 2026.02	85.6	86.2
Skywork-Reward-V2-Llama-3.1-8B 2026.02	84.1	84.3
Skywork-Reward-V2-Llama-3.1-8B 2025.07	84.1	-
OpenRS 2026.02	83.7	84.9
Skywork-Reward-8B 2026.03	79.7	-
Skywork-Reward-V2-Qwen3-8B 2025.07	78.2	-
Mix-GRM 2026.03	77.5	-
Llama-3.1-Nemotron-70B 2026.02	76.7	70.5
QRM-Gemma-2-27B 2025.07	76.7	-
Llama-3.1-Nemotron-70B 2025.07	76.7	-
INF-ORM-Llama3.1-70B 2026.02	76.5	71.7
INF-ORM-Llama3.1-70B 2025.07	76.5	-
Skywork-Reward-Gemma-2-27B 2025.07	75.8	-
Skywork-Reward-V2-Qwen3-4B 2025.07	75.5	-
Skywork-Reward-Gemma-2-27B-v0.2 2026.02	75.3	67.3
Skywork-Reward-Gemma-2-27B-v0.2 2025.07	75.3	-
Skywork-Reward-V2-Llama-3.2-3B 2025.07	74.7	-
Base-GRM 2026.03	74	-
URM-LLaMa-3.1-8B 2025.07	73.9	-
FARE-8B 2026.03	73.4	-
Skywork-Reward-Llama-3.1-8B 2025.07	73.1	-
LDL-Reward-Gemma-2-27B-v0.1 2026.02	72.5	67.4
LDL-Reward-Gemma-2-27B-v0.1 2025.07	72.5	-
RubricRM-8B 2026.03	71.9	-
Skywork-Reward-Llama-3.1-8B-v0.2 2026.02	71.8	67.1
Skywork-Reward-Llama-3.1-8B-v0.2 2025.07	71.8	-
QRM-Llama3.1-8B-v2 2025.07	70.7	-
QRM-Llama3.1-8B 2025.07	70.7	-
Skywork/Skywork-VL-Reward-7B 2026.02	68.847	-
Skywork-Reward-V2-Qwen3-1.7B 2025.07	68.3	-
Mix-GRM 2026.03	67.8	-
GRM-Llama3-8B-rewardmodel-ft 2025.07	67.7	-
ArmoRM-Llama3-8B-v0.1 2026.02	66.5	63.4
ArmoRM-Llama3-8B-v0.1 2025.07	66.5	-
GPT-4o 2025.07	64.9	-
Llama-3-OffsetBias-RM-8B 2026.02	64.8	65
Llama-3-OffsetBias-RM-8B 2025.07	64.8	-
Base-GRM 2026.03	64.7	-
Claude-3.5-Sonnet 2025.07	64.7	-
Skywork-Reward-V2-Llama-3.2-1B 2025.07	64.3	-
FsfairX-LLaMA3-RM-v0.1 2025.07	62.9	-
RM-R1-7B (Instruct) 2026.03	61.4	-
Skywork-Reward-V2-Qwen3-0.6B 2025.07	61.3	-
GRM-gemma2-2B-rewardmodel-ft 2025.07	59.7	-
weqweasdas/RM-Mistral-7B 2026.02	59.601	-
RM-Mistral-7B 2025.07	59.6	-
GRM-llama3-8B-distill 2025.07	58.9	-
Eurus-RM-7b 2025.07	58.1	-
openbmb/Eurus-RM-7b 2026.02	58.057	-
BTRM Qwen2 7b 0613 2025.07	57.4	-
CIR-AMS/BTRM_Qwen2_7b_0613 2026.02	57.363	-
Finemath-RM-Qwen-2.5-7B 2026.02	57	-
Internlm2-20b-reward 2026.02	56.3	64.8
Internlm2-20b-reward 2025.07	56.3	-
DeepSeek-GRM-16B 2026.03	56	-
JudgeLRM-7B 2026.03	55.6	-
Internlm2-7b-reward 2025.07	53.4	-
internlm/internlm2-7b-reward 2026.02	53.348	-
RM-R1-7B (Distill) 2026.03	48.7	-
weqweasdas/RM-Gemma-7B 2026.02	48.255	-
Starling-RM-34B 2025.07	45.5	-
internlm2-1.8b-reward 2025.07	39	-
PKU-Alignment/beaver-7b-v1.0-cost 2026.02	33.322	-
PKU-Alignment/beaver-7b-v2.0-cost 2026.02	33.261	-
PKU-Alignment/beaver-7b-v2.0-reward 2026.02	25.435	-
PKU-Alignment/beaver-7b-v1.0-reward 2026.02	16.057	-
Skywork/Skywork-Reward-V2-Qwen3-4B 2026.02	-	75.51
Skywork/Skywork-Reward-V2-Llama-3.2-3B 2026.02	-	74.665
Schrieffer/Llama-SARM-4B 2026.02	-	73.793
Skywork/Skywork-Reward-V2-Qwen3-1.7B 2026.02	-	68.176
Skywork/Skywork-Reward-V2-Llama-3.2-1B 2026.02	-	64.376
Skywork/Skywork-Reward-V2-Qwen3-0.6B 2026.02	-	61.25
Ray2333/GRM-gemma2-2B-rewardmodel-ft 2026.02	-	59.661
Finemath-RM-Qwen-2.5-3B 2026.02	-	46.2
Finemath-RM-Llama-3.2-3B 2026.02	-	36.2
weqweasdas/RM-Gemma-2B 2026.02	-	30.566
OpenAssistant/oasst-rm-2.1-pythia-1.4b-epoch-2.5 2026.02	-	26.479
weqweasdas/hh_rlhf_rm_open_llama_3b 2026.02	-	24.98