Local optimisation of Nyström samples through stochastic gradient descent

03/24/2022
by   Matthew Hutchings, et al.
0

We study a relaxed version of the column-sampling problem for the Nyström approximation of kernel matrices, where approximations are defined from multisets of landmark points in the ambient space; such multisets are referred to as Nyström samples. We consider an unweighted variation of the radial squared-kernel discrepancy (SKD) criterion as a surrogate for the classical criteria used to assess the Nyström approximation accuracy; in this setting, we discuss how Nyström samples can be efficiently optimised through stochastic gradient descent. We perform numerical experiments which demonstrate that the local minimisation of the radial SKD yields Nyström samples with improved Nyström approximation accuracy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/30/2020

On the Discrepancy Principle for Stochastic Gradient Descent

Stochastic gradient descent (SGD) is a promising numerical method for so...
research
11/22/2011

Stochastic gradient descent on Riemannian manifolds

Stochastic gradient descent is a simple approach to find the local minim...
research
06/10/2020

Stochastic Gradient Descent for Semilinear Elliptic Equations with Uncertainties

Randomness is ubiquitous in modern engineering. The uncertainty is often...
research
12/01/2019

Borrowing From the Future: An Attempt to Address Double Sampling

For model-free reinforcement learning, the main difficulty of stochastic...
research
08/23/2020

Multi-kernel Passive Stochastic Gradient Algorithms

This paper develops a novel passive stochastic gradient algorithm. In pa...
research
02/05/2016

Reducing Runtime by Recycling Samples

Contrary to the situation with stochastic gradient descent, we argue tha...
research
01/21/2011

A fast and recursive algorithm for clustering large datasets with k-medians

Clustering with fast algorithms large samples of high dimensional data i...

Please sign up or login with your details

Forgot password? Click here to reset