SOTA Ranking Prediction benchmarks and papers with code

Benchmarks

Dataset Name	SOTA Method	Metric
PREF-SOI (out-of-sample (five-fold cross-validation))	CRS	NLL3.9	5	4mo ago
PREF-SOC five-fold cross-validation (out-of-sample)		Negative Log-Likelihood5.52	5	4mo ago
LETOR five-fold cross-validation (out-of-sample)	CRS	Negative Log-Likelihood9.8	5	4mo ago
nascar five-fold cross-validation (out-of-sample)	CRS	Negative Log-Likelihood102.6	5	4mo ago
meath (out-of-sample (five-fold cross-validation))	CRS	Negative Log-Likelihood7.56	5	4mo ago
dub-w (out-of-sample five-fold cross-validation)	CRS	Negative Log-Likelihood5.86	5	4mo ago
dub-n five-fold cross-validation (out-of-sample)	CRS	Negative Log-Likelihood7.59	5	4mo ago
sushi (out-of-sample (five-fold cross-validation))	CRS	NLL13.47	5	4mo ago
Evol-CodeAlpaca R1	PARS	Kendall's Tau0.46	4	26d ago
Evol-CodeAlpaca Llama	PARS	Kendall's Tau0.61	4	26d ago
MATH-plus R1	PARS	Kendall's Tau0.73	4	26d ago
MATH-plus Llama	PARS	Kendall's Tau0.65	4	26d ago
LMSYS-Chat-1M R1	PARS	Kendall's Tau0.5	4	26d ago
LMSYS-Chat-1M Llama	PARS	Kendall's Tau0.65	4	26d ago
Alpaca R1	PARS	Kendall's Tau (τb)0.61	4	26d ago
Alpaca Llama	PARS	Kendall's Tau0.75	4	26d ago
Evol-CodeAlpaca GPT-4	PARS	Kendall's Tau0.62	3	26d ago
MATH-plus GPT-4	PARS	Kendall's Tau0.71	3	26d ago
LMSYS-Chat-1M GPT-4	PARS	Kendall's Tau0.72	3	26d ago
Alpaca GPT-4	PARS	Kendall's Tau0.96	3	26d ago

Showing 20 of 20 rows