Share your thoughts, 1 month free Claude Pro on usSee more

Alignment Reward Evaluation on OffsetBias (test)

67.94Reward

SFT+DPO

Updated 26d ago

Evaluation Results

Method	Links
SFT+DPO 2025.02		67.94
SFT+VAR 2025.02		66.44
VAR 2025.02		66.06
SFT+VAR 2025.02		65.88
DPO 2025.02		65.81
SFT+VAR 2025.02		65.75
SFT+VAR 2025.02		65.63
VAR 2025.02		65.63
VAR 2025.02		65.38
SFT+VAR 2025.02		65.38
VAR 2025.02		64.75
VAR 2025.02		63.91
SFT+DPO 2025.02		63.81
SFT+VAR 2025.02		63.72
DPO 2025.02		62.94
SFT+VAR 2025.02		62.59
SFT+VAR 2025.02		61.97
VAR 2025.02		61.44
VAR 2025.02		60.88
SFT+DPO 2025.02		60.88
SFT+VAR 2025.02		60.63
VAR 2025.02		59.5
SFT+DPO 2025.02		59.09
SFT+DPO 2025.02		59.09
SFT+VAR 2025.02		59.09
DPO 2025.02		58.97
VAR 2025.02		57.69
SFT+DPO 2025.02		57.63
SFT+DPO 2025.02		56.91
VAR 2025.02		56.81
DPO 2025.02		56.63
SFT+DPO 2025.02		55.88
Base 2025.02		54.09
DPO 2025.02		53.94
DPO 2025.02		53.44
SFT+DPO 2025.02		52.63
DPO 2025.02		51.75
DPO 2025.02		51.38
Base 2025.02		45.16
Base 2025.02		45.06
Base 2025.02		40.38
Base 2025.02		38.97
DPO 2025.02		37.31
DPO 2025.02		32.38
Base 2025.02		30.42
SFT+DPO 2025.02		30.23
Base 2025.02		27.05
Base 2025.02		26.61
Base 2025.02		26.52
Base 2025.02		21