Our new X account is live! Follow @wizwand_team for updates

Reward Modeling on RewardBench

95.1Avg Score

INF-ORM-Llama3.1-70B

Updated 4d ago

Evaluation Results

Method
INF-ORM-Llama3.1-70B 2025.01	95.1	96.6	91	93.6	99.1
Skyword-Reward-Llama3.1-8B 2025.01	92.5	95.8	87.3	90.8	96.2
Nemotron-4 340B RM (w. HelpSteer2) 2024.06	92	95.8	87.1	91.5	93.7
ArmoRM-Llama 3 8B 2024.06	90.8	96.9	76.8	92.2	97.3
InternLM2-20B-Reward 2025.01	90.2	98.9	76.5	89.5	95.8
Cohere May 2024 2024.06	89.5	96.4	71.3	92.7	97.7
Llama 3 70B RM (w. HelpSteer2) 2024.06	88.8	91.3	80.3	92.8	90.7
IXC-2.5-Reward 2025.01	88.6	90.8	83.8	87.8	90
DRMs(Ours) 2025.02	88.5	98.6	75.5	88.5	91.4
Gemini 1.5 Pro-0514 2024.06	88.1	92.3	80.6	87.5	92
InternLM2-7B-Reward 2025.01	87.6	99.2	69.5	87.2	94.5
Shared-Base 2025.02	87.3	98.6	68.4	89.5	92.7
PairRM-LLaMA3-8B 2024.06	87.13	98.3	65.8	89.7	94.7
Single Head 2025.02	87.1	98.9	68.4	89.1	92
Cohere March 2024 2024.06	87.1	94.7	65.1	90.3	98.2
RLHFlow-Llama 3 8B 2024.06	87.1	98.3	65.8	89.7	94.7
GRM 2024.06	87	98.6	67.8	89.4	92.3
Random (Gaussian) 2025.02	86.8	98.2	66.3	88.9	93.6
SKYWORK + SSO_DPO 2024.10	86.3	93.9	75.4	86.6	89.3
GPT-4-0125-preview 2024.06	85.9	95.3	74.3	87.2	86.9
gpt-4-0125-preview 2024.06	85.9	95.3	74.3	87.2	86.9
Random (Uniform) 2025.02	85.7	98.5	62.3	90.3	91.5
UltraMedRM-8B 2024.06	85.53	97.21	67.11	91.19	86.62
FsfairX-LLaMA3-RM-v0.1 2024.06	85.34	99.16	64.69	86.89	90.64
SKYWORK + ULTRAFEEDBACK 2024.10	85.1	94.7	72.7	89.1	83.9
GPT-4-0613 2024.06	85.1	95.3	75.4	87.1	82.7
gpt-4-turbo-2024-04-09 2024.06	85.1	95.3	75.4	87.1	82.7
GPT-4o-0513 2024.06	84.7	96.6	70.4	86.7	84.9
FsfairX-LLaMA3-RM-8B 2024.06	84.7	99.4	65.1	87.8	86.4
SKYWORK 2024.10	84.5	91.6	78.6	88.2	79.7
RM-Distiller 2026.01	84.5	91.3	69.7	85.5	91.3
Claude-3.5-Sonnet-20240620 2026.01	84.2	96.4	74	81.6	84.7
Llama-3.1-70B-Instruct 2026.01	84.1	97.2	70.2	82.8	86
Qwen3-14B 2026.01	83.9	96.4	69.2	88	82
QWen2-VL-7B 2025.01	83.8	96.6	57	73.9	94.3
GRAM-LLaMA3.2-3B-RewardModel 2026.01	83.6	90.6	83.9	79.8	80.2
RM-Distiller 2026.01	83.6	92.7	64.3	90.7	86.9
SKYWORK + PBAA_DPO 2024.10	83.5	93.3	75.1	86.5	79
Eurus-RM-7B 2024.06	83.01	98.04	62.72	81.89	89.38
Eurus RM Mistral 7B 2024.06	82.8	98	65.6	81.2	86.3
Starling RM Yi 34B 2024.06	82.7	96.9	57.2	88.2	88.5
Starling-RM-34B 2024.06	82.7	96.9	57.2	88.2	88.5
GPT-4o 2026.01	82.4	96.1	70.7	87.8	75.1
SynRM 2026.01	82.2	81	82.5	86.9	78.6
RMBoost 2026.01	81.7	82.7	73.7	82.2	88.2
Eurus-RM-7B 2026.01	81.6	98	65.6	81.4	86.3
NORMBT 2025.12	81.48	83.8	78.73	88.78	74.6
DRMs(Ours) 2025.02	81.4	95.3	65	78.3	87.2
Claude-3-Opus-02292024 2024.06	80.7	94.7	60.3	89.1	78.7
BT (baseline) 2025.12	80.31	86.03	78.29	89.86	67.05
RMBoost 2026.01	80.3	85.8	73.7	86.6	74.9
RM-Distiller 2026.01	80.2	95	55	81.8	89
NORMBT 2025.12	80.12	83.8	73.46	82.5	80.71
SSO_DPO 2024.10	80	95.3	59	77.4	88.3
LLaVA-Critic-8B 2025.01	80	96.9	52.8	81.7	83.5
Margin BT 2026.01	79.9	88.6	72.8	86.6	71.6
SynRM 2026.01	79.7	78.2	80.7	85.1	74.8
ULTRAFEEDBACK 2024.10	79.5	96.9	61.8	79.2	80.2
RM-Distiller 2026.01	79.5	95.5	51.1	84.1	87.4
LSAM 2026.01	79.3	93	69.7	84.1	70.4
Llama 3 70B (w. Open Assistant) 2024.06	79.1	91.3	59.2	76	89.9
PBAA_DPO 2024.10	78.9	96.9	59.9	77.2	81.6
Random (Uniform) 2025.02	78.7	94	56.7	80	84.3
BT (baseline) 2025.12	78.63	81.28	73.36	82.43	77.46
Random (Gaussian) 2025.02	78.6	95.1	57.3	78.1	83.9
GRM w/ dpo noref 2024.06	78.6	97.8	54.6	82	79.9
Margin BT 2026.01	78.6	88.6	70.8	87.3	67.8
GRM w/ sft 2024.06	78.4	97.2	54.2	83.6	78.6
SteerLM 2026.01	78.4	89.7	69.5	87.2	67.1
FR RM 2025.05	78.38	94.41	57.02	78.24	83.86
GRM (linear) w/ sft 2024.06	78.3	96.7	52.4	81.5	82.5
BT RM 2025.05	78.11	93.02	57.02	77.43	84.98
SynRM 2026.01	78	84.9	57	79.1	91.1
GRM (linear) w/ dpo noref 2024.06	77.8	96.9	52.9	82.7	78.8
FC RM 2025.05	77.5	94.41	53.29	76.76	85.53
LSAM 2026.01	77	89.4	66.5	88.1	63.8
Llama 3 70B Instruct 2024.06	76	97.6	58.9	69.2	78.5
SynRM 2026.01	75.4	96.1	47.6	78.7	79.1
Prometheus 2 Mistral 8x7B 2024.06	75.3	93	47.1	83.5	77.4
JudgeLRM-7B 2026.01	75.2	92.9	56.4	78.2	73.6
RMBoost 2026.01	75.2	92.7	43.6	73.7	90.6
SteerLM 2026.01	75.2	91.6	65.4	80.4	63.5
SteerLM 2026.01	74.5	94.4	46.5	74.3	82.8
Shared-Base 2025.02	74	94.7	47.6	76.5	77.4
SteerLM 2026.01	74	93.6	45	79.1	78.5
Llama 3 70B (w. HH-RLHF) 2024.06	73.9	94.4	54.6	81.2	65.6
BT Classifier 2026.01	73.8	77.4	71.3	86.5	60
Single Head 2025.02	73.3	94.4	46.7	75.9	75.9
Margin BT 2026.01	72.8	94.7	46.3	79.9	70.4
LSAM 2026.01	72.5	92.5	39.9	72.7	84.9
BT-BNRM 2026.02	72.5	95.6	43.3	80.9	70.1
Classifier + label smooth 2024.06	72.1	94.1	47.1	67.5	79.7
CLoud 2026.01	71.9	83	67.3	75	62.2
BT Classifier 2026.01	71.8	88	43.4	72.4	83.5
GRM-BNRM 2026.02	71.8	95.7	41.6	81.5	68.4
LSAM 2026.01	71.6	94.1	37.3	73.5	81.4
Margin BT 2026.01	70.4	93.6	33.6	73.5	80.8
BT Classifier 2026.01	70.3	93.3	37.7	69.3	81
Pythia 1.4B (w. Open Assistant) 2024.06	70	88.5	48.7	65.3	77.5
GRM (linear) w/ sft 2024.06	69.5	94.7	40.8	65.4	77

Showing 100 of 118 rows