Developing a Ranking Problem Library (RPLIB) from a data-oriented perspective

06/21/2022
by   Paul E. Anderson, et al.
0

We present an improved library for the ranking problem called RPLIB. RPLIB includes the following data and features. (1) Real and artificial datasets of both pairwise data (i.e., information about the ranking of pairs of items) and feature data (i.e., a vector of features about each item to be ranked). These datasets range in size (e.g., from small n=10 item datasets to large datasets with hundred of items), application (e.g., from sports to economic data), and source (e.g. real versus artificially generated to have particular structures). (2) RPLIB contains code for the most common ranking algorithms such as the linear ordering optimization method and the Massey method. (3) RPLIB also has the ability for users to contribute their own data, code, and algorithms. Each RPLIB dataset has an associated .JSON model card of additional information such as the number and set of optimal rankings, the optimal objective value, and corresponding figures.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/12/2021

On the Linear Ordering Problem and the Rankability of Data

In 2019, Anderson et al. proposed the concept of rankability, which refe...
research
01/04/2018

Approximate Ranking from Pairwise Comparisons

A common problem in machine learning is to rank a set of n items based o...
research
05/30/2019

Evaluating Artificial Systems for Pairwise Ranking Tasks Sensitive to Individual Differences

Owing to the advancement of deep learning, artificial systems are now ri...
research
10/29/2018

Modelling rankings in R: the PlackettLuce package

This paper presents the R package PlackettLuce, which implements a gener...
research
10/01/2021

Lagrangian Inference for Ranking Problems

We propose a novel combinatorial inference framework to conduct general ...
research
05/31/2023

Decomposition and Interleaving for Variance Reduction of Post-click Metrics

In this study, we propose an efficient method for comparing the post-cli...
research
10/15/2018

Dimensionality Reduction and (Bucket) Ranking: a Mass Transportation Approach

Whereas most dimensionality reduction techniques (e.g. PCA, ICA, NMF) fo...

Please sign up or login with your details

Forgot password? Click here to reset