Improved Fixed-Rank Nyström Approximation via QR Decomposition: Practical and Theoretical Aspects

The Nyström method is a popular technique for computing fixed-rank approximations of large kernel matrices using a small number of landmark points. In practice, to ensure high quality approximations, the number of landmark points is chosen to be greater than the target rank. However, the standard Nyström method uses a sub-optimal procedure for rank reduction mainly due to its simplicity. In this paper, we highlight the drawbacks of standard Nyström in terms of poor performance and lack of theoretical guarantees. To address these issues, we present an efficient method for generating improved fixed-rank Nyström approximations. Theoretical analysis and numerical experiments are provided to demonstrate the advantages of the modified method over the standard Nyström method. Overall, the aim of this paper is to convince researchers to use the modified method, as it has nearly identical computational complexity, is easy to code, and has greatly improved accuracy in many cases.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/20/2016

Randomized Clustered Nystrom for Large-Scale Kernel Machines

The Nystrom method has been popular for generating the low-rank approxim...
research
05/24/2016

Recursive Sampling for the Nyström Method

We give the first algorithm for kernel Nyström approximation that runs i...
research
02/10/2021

Fast and stable deterministic approximation of general symmetric kernel matrices in high dimensions

Kernel methods are used frequently in various applications of machine le...
research
01/23/2023

Sampling-based Nyström Approximation and Kernel Quadrature

We analyze the Nyström approximation of a positive definite kernel assoc...
research
02/21/2023

Boosting Nyström Method

The Nyström method is an effective tool to generate low-rank approximati...
research
05/04/2023

On the Unreasonable Effectiveness of Single Vector Krylov Methods for Low-Rank Approximation

Krylov subspace methods are a ubiquitous tool for computing near-optimal...
research
07/11/2023

Making the Nyström method highly accurate for low-rank approximations

The Nyström method is a convenient heuristic method to obtain low-rank a...

Please sign up or login with your details

Forgot password? Click here to reset