Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Learning Rich Rankings

About

Although the foundations of ranking are well established, the ranking literature has primarily been focused on simple, unimodal models, e.g. the Mallows and Plackett-Luce models, that define distributions centered around a single total ordering. Explicit mixture models have provided some tools for modelling multimodal ranking data, though learning such models from data is often difficult. In this work, we contribute a contextual repeated selection (CRS) model that leverages recent advances in choice modeling to bring a natural multimodality and richness to the rankings space. We provide rigorous theoretical guarantees for maximum likelihood estimation under the model through structure-dependent tail risk and expected risk bounds. As a by-product, we also furnish the first tight bounds on the expected risk of maximum likelihood estimators for the multinomial logit (MNL) choice model and the Plackett-Luce (PL) ranking model, as well as the first tail risk bound on the PL ranking model. The CRS model significantly outperforms existing methods for modeling real world ranking data in a variety of settings, from racing to rank choice voting.

Arjun Seshadri, Stephen Ragain, Johan Ugander• 2023

Related benchmarks

TaskDatasetResultRank
Ranking Predictionsushi (out-of-sample (five-fold cross-validation))
NLL13.47
5
Ranking Predictiondub-n five-fold cross-validation (out-of-sample)
Negative Log-Likelihood7.59
5
Ranking Predictiondub-w (out-of-sample five-fold cross-validation)
Negative Log-Likelihood5.86
5
Ranking Predictionmeath (out-of-sample (five-fold cross-validation))
Negative Log-Likelihood7.56
5
Ranking Predictionnascar five-fold cross-validation (out-of-sample)
Negative Log-Likelihood102.6
5
Ranking PredictionLETOR five-fold cross-validation (out-of-sample)
Negative Log-Likelihood9.8
5
Ranking PredictionPREF-SOI (out-of-sample (five-fold cross-validation))
NLL3.9
5
Ranking PredictionPREF-SOC five-fold cross-validation (out-of-sample)
Negative Log-Likelihood5.53
5
Showing 8 of 8 rows

Other info

Code

Follow for update