Human Evaluation

Benchmarks

Dataset Name	SOTA Method	Metric
ESConv	KEMI	Win Rate70	36	15d ago
NeurIPS ICML ICLR Proposals 2025 (test)	Stepwise CoT	Wins31	6	18d ago
CulturalVQA OOD (test)	MMBoundary	Faithfulness7.66	6	1mo ago
ScienceVQA (test)	MMBoundary	Faithfulness Score8.35	6	1mo ago
A-OKVQA (test)	MMBoundary	Faithfulness Score7.83	6	1mo ago
UltraFeedback 50 sampled questions	OTPO	Win Rate (Expert 1)62	5	1mo ago
RCC-PVD (evaluation)	Ranking	Rank Preference Rate61	4	22d ago
Human Evaluation	Ann Brown	Trustworthiness0.86	4	1mo ago
Human Evaluation Evil Players	GRAIL Agent	Contributed Success3.78	3	5d ago
MathQA	Ours	Accuracy89.2	3	1mo ago
50 randomly selected model responses	GPT-4.1	Clarity98	3	1mo ago
Human Evaluation Set (test)	LongDPO	Win Rate0.65	3	1mo ago
200 human-generated instructions	Olympus	Success Rate0.865	3	1mo ago
HH dataset	RRHF_DP	Win Rate59	3	1mo ago
MS MARCO (test)	RBG	Preference: FiD18	3	1mo ago
K/DA and K-OMG (50 random samples)		Overall Offensiveness Score3.24	2	1mo ago
LongBench Chat	LongReward + DPO	Helpfulness Win Rate14	1	1mo ago
WMT English-Czech 2019	binmt	Preference: Much Better0.5	1	1mo ago
Tools 100 pairs	DiffLM	Win Rate88	1	1mo ago

Showing 19 of 19 rows