SOTA Human Preference Evaluation benchmarks and papers with code

Benchmarks

Dataset Name	SOTA Method	Metric
ImageReward	SparVAR	Average Score1.0533	40	1mo ago
HPD v2 (test)	HPSv3 - 7B	Preference Accuracy85.4	32	7d ago
ImageReward (test)	MPS	Preference Accuracy0.675	32	7d ago
HPS v2.1	+FastVAR	Photo Score29.87	24	3mo ago
Human Preference for Oral Argument Simulation (Evaluation set)	Gemini-2.5-Pro	Wins72	9	2mo ago
Basque Arena		Arena Content Score1,183	7	2mo ago
MHP Overall (test)	MPS	Preference Accuracy74.2	7	3mo ago
Long Videos 50 60s	Stream-R1	Win Count30	5	28d ago
Minecraft Human Preference Study (model-vs-model trials)	MD4	Wins290	4	1mo ago
364 scientific paper pairs (original vs. AI-revised)	APRES	Preference Percentage47.8	4	3mo ago
VideoPhy 1.0 (test)	MAGI-1	Physics Plausibility Win Rate59.3	4	3mo ago
PhysicsIQ 1.0 (test)	MAGI-1	Physics Plausibility Win Rate54.9	4	3mo ago
Arena (Phase 2)	google/gemma-3-27b-it	Total Battles200	3	21d ago
TPI (test)	TPI-Full	Preferred Rate66.05	3	1mo ago
Cooking	Stitch-a-Demo	Step Faithfulness Win Rate94	3	1mo ago
Arena Creative Writing	JS	Win Rate23.4	3	3mo ago
Arena-Hard v0.1	JS	Win Rate56.7	3	3mo ago
User Study (Group 2)	UAV-GPT	Category CT Score24	3	3mo ago
EgoDex and DreamDojo-HV novel out-of-distribution (eval)	DreamDojo-14B	Physics Correctness73.5	3	3mo ago
Human Preference Evaluation 371 prompts (test)	HPS	Recall @139.89	3	3mo ago
Human Preference Evaluation 466 prompts (test)	ImageReward	Preference Accuracy65.14	3	3mo ago
HPD Concept-Art v2	RealAlign	Win Rate73.33	2	14d ago
HPD Anime v2	RealAlign	Win Rate73.33	2	14d ago
Kuaishou search long-tail query segment (test)	ExpModel	Good Count48	2	2mo ago
PROSOCIALDIALOG	NormGenesis (with V2R)	Preference82	2	2mo ago

Showing 25 of 29 rows