SOTA Reward Prediction benchmarks and papers with code

Benchmarks

Dataset Name	SOTA Method	Metric
RewardPrediction	VLWM-critic	AlfWorld Reward Score82.3	13	1mo ago
RoboRewardBench 1.0	RoboReward 8B	Overall MAE0.665	12	1mo ago
D18	Bid2X	MAE4.01	10	1mo ago
D12	Bid2X	MAE5.45	10	1mo ago
D6	Bid2X	MAE7.82	10	1mo ago
BL	Bid2X	MAE170.03	10	1mo ago
BM	Bid2X	MAE31.91	10	1mo ago
BS	Bid2X	Mean Absolute Error (MAE)7.76	10	1mo ago
TR	Bid2X	MAE8.9	10	1mo ago
BCB	Bid2X	MAE5.94	10	1mo ago
UI-TARS-7B trajectories	PRORE	Accuracy96.5	9	3d ago
M3A trajectories	PRORE	Accuracy91.4	9	3d ago
V-Droid trajectories	PRORE	Accuracy93.1	9	3d ago
RoboRewardBench	RoboReward-8B	MAE0.67	8	1mo ago
Human preference annotation (test)		Effort30	8	1mo ago
Out-of-Domain Task Suite NuminaMath, SIQA, PIQA	MemReward	Average Score66.96	6	26d ago
PIQA (out-of-domain)		Accuracy82.22	6	26d ago
SIQA (out-of-domain)	MemReward	Accuracy76.89	6	26d ago
NuminaMath (out-of-domain)	MemReward	Accuracy42.22	6	26d ago
OSWorld Chrome	PRORE	Reward Accuracy93.5	5	3d ago
OSWorld	PRORE	Reward Accuracy92	5	3d ago
ManiSkill (image-based) 4-task Color Swapped (OOD)	ReCouPLe-EC	Pick Score96	5	1mo ago
ManiSkill image-based 4-task In Distribution	ReCouPLe-EC	Pick Score98	5	1mo ago
ManiSkill image-based 2-task Color Swapped (OOD)	ReCouPLe-EC	Pick Success Rate70.7	5	1mo ago
ManiSkill image-based 2-task In Distribution	ReCouPLe-EC	Pick Score98	5	1mo ago

Showing 25 of 27 rows