Relating Leverage Scores and Density using Regularized Christoffel Functions

05/21/2018
by   Edouard Pauwels, et al.
0

Statistical leverage scores emerged as a fundamental tool for matrix sketching and column sampling with applications to low rank approximation, regression, random feature learning and quadrature. Yet, the very nature of this quantity is barely understood. Borrowing ideas from the orthogonal polynomial literature, we introduce the regularized Christoffel function associated to a positive definite kernel. This uncovers a variational formulation for leverage scores for kernel methods and allows to elucidate their relationships with the chosen kernel as well as population density. Our main result quantitatively describes a decreasing relation between leverage score and population density for a broad class of kernels on Euclidean spaces. Numerical simulations support our findings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/21/2020

Generalized Leverage Score Sampling for Neural Networks

Leverage score sampling is a powerful technique that originates from the...
research
10/31/2018

On Fast Leverage Score Sampling and Optimal Learning

Leverage score sampling provides an appealing way to perform approximate...
research
02/05/2016

On Column Selection in Approximate Kernel Canonical Correlation Analysis

We study the problem of column selection in large-scale kernel canonical...
research
05/04/2015

An Explicit Sampling Dependent Spectral Error Bound for Column Subset Selection

In this paper, we consider the problem of column subset selection. We pr...
research
09/06/2018

Large Scale Learning with Kreĭn Kernels

We extend the Nyström method for low-rank approximation of positive defi...
research
03/20/2019

On Sampling Random Features From Empirical Leverage Scores: Implementation and Theoretical Guarantees

Random features provide a practical framework for large-scale kernel app...
research
02/22/2020

Kernel interpolation with continuous volume sampling

A fundamental task in kernel methods is to pick nodes and weights, so as...

Please sign up or login with your details

Forgot password? Click here to reset