On kernel methods for covariates that are rankings

03/25/2016
by   Horia Mania, et al.
0

Permutation-valued features arise in a variety of applications, either in a direct way when preferences are elicited over a collection of items, or an indirect way in which numerical ratings are converted to a ranking. To date, there has been relatively limited study of regression, classification, and testing problems based on permutation-valued features, as opposed to permutation-valued responses. This paper studies the use of reproducing kernel Hilbert space methods for learning from permutation-valued features. These methods embed the rankings into an implicitly defined function space, and allow for efficient estimation of regression and test functions in this richer space. Our first contribution is to characterize both the feature spaces and spectral properties associated with two kernels for rankings, the Kendall and Mallows kernels. Using tools from representation theory, we explain the limited expressive power of the Kendall kernel by characterizing its degenerate spectrum, and in sharp contrast, we prove that Mallows' kernel is universal and characteristic. We also introduce families of polynomial kernels that interpolate between the Kendall (degree one) and Mallows' (infinite degree) kernels. We show the practical effectiveness of our methods via applications to Eurobarometer survey data as well as a Movielens ratings dataset.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/28/2015

Operator-valued Kernels for Learning from Functional Response Data

In this paper we consider the problems of supervised classification and ...
research
10/28/2021

Kernel-based Partial Permutation Test for Detecting Heterogeneous Functional Relationship

We propose a kernel-based partial permutation test for checking the equa...
research
10/10/2019

On the Dualization of Operator-Valued Kernel Machines

Operator-Valued Kernels (OVKs) and Vector-Valued Reproducing Kernel Hilb...
research
02/13/2019

On the Expressive Power of Kernel Methods and the Efficiency of Kernel Learning by Association Schemes

We study the expressive power of kernel methods and the algorithmic feas...
research
01/14/2021

Entangled Kernels – Beyond Separability

We consider the problem of operator-valued kernel learning and investiga...
research
07/01/2018

Antithetic and Monte Carlo kernel estimators for partial rankings

In the modern age, rankings data is ubiquitous and it is useful for a va...
research
05/26/2021

Submodular Kernels for Efficient Rankings

Many algorithms for ranked data become computationally intractable as th...

Please sign up or login with your details

Forgot password? Click here to reset