SOTA Gold-standard ranking agreement on combined benchmark and PapersWithCode

0.8647Mean Kendall's Tau-b

baldwin_rank_ties_average

Updated 1mo ago

Evaluation Results

Method
baldwin_rank_ties_average 2026.03	0.8647	0.0486
bayes 2026.03	0.8647	0.0486
bayes_ci 2026.03	0.8647	0.0486
borda 2026.03	0.8647	0.0486
copeland 2026.03	0.8647	0.0486
majority_judgment 2026.03	0.8647	0.0486
avg 2026.03	0.8647	0.0486
minimax_variant_margin_tie_half 2026.03	0.8647	0.0486
minimax_variant_margin_tie_ignore 2026.03	0.8647	0.0486
minimax_variant_winning_votes_tie_half 2026.03	0.8647	0.0486
nash_advantage_vs_equilibrium 2026.03	0.8647	0.0486
nash_vs_equilibrium 2026.03	0.8647	0.0486
pagerank 2026.03	0.8647	0.0486
rank_centrality_tie_half 2026.03	0.8647	0.0486
ranked_pairs_strength_margin_tie_half 2026.03	0.8647	0.0486
ranked_pairs_strength_margin_tie_ignore 2026.03	0.8647	0.0486
ranked_pairs_strength_winning_votes_tie_half 2026.03	0.8647	0.0486
ranked_pairs_strength_winning_votes_tie_ignore 2026.03	0.8647	0.0486
schulze_tie_half 2026.03	0.8647	0.0486
schulze_tie_ignore 2026.03	0.8647	0.0486
spectral 2026.03	0.8647	0.0486
alpharank 2026.03	0.8646	0.0486
rasch_mml_credible 2026.03	0.8642	0.0351
hodge_rank_binary_uniform 2026.03	0.8623	0.0491
hodge_rank_binary_decisive 2026.03	0.8623	0.0484
hodge_rank_binary_total 2026.03	0.8616	0.0493
serial_rank_sign 2026.03	0.8615	0.0503
hodge_rank_log_odds_total 2026.03	0.8603	0.0482
hodge_rank_log_odds_uniform 2026.03	0.8603	0.0482
rao_kupper_map 2026.03	0.8603	0.0483
rao_kupper 2026.03	0.8601	0.0484
nanson_rank_ties_average 2026.03	0.8067	0.0363
bradley_terry_luce_map 2026.03	0.8064	0.0556
bradley_terry_luce 2026.03	0.8058	0.0554
bayes_greedy 2026.03	0.7856	0.0309
nanson_rank_ties_max 2026.03	0.7825	0.0394