An Inverse-free Truncated Rayleigh-Ritz Method for Sparse Generalized Eigenvalue Problem

03/24/2020
by   Yunfeng Cai, et al.
10

This paper considers the sparse generalized eigenvalue problem (SGEP), which aims to find the leading eigenvector with at most k nonzero entries. SGEP naturally arises in many applications in machine learning, statistics, and scientific computing, for example, the sparse principal component analysis (SPCA), the sparse discriminant analysis (SDA), and the sparse canonical correlation analysis (SCCA). In this paper, we focus on the development of a three-stage algorithm named inverse-free truncated Rayleigh-Ritz method ( IFTRR) to efficiently solve SGEP. In each iteration of IFTRR, only a small number of matrix-vector products is required. This makes IFTRR well-suited for large scale problems. Particularly, a new truncation strategy is proposed, which is able to find the support set of the leading eigenvector effectively. Theoretical results are developed to explain why IFTRR works well. Numerical simulations demonstrate the merits of IFTRR.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/25/2019

Eigenvalue and Generalized Eigenvalue Problems: Tutorial

This paper is a tutorial for eigenvalue and generalized eigenvalue probl...
research
12/12/2011

Truncated Power Method for Sparse Eigenvalue Problems

This paper considers the sparse eigenvalue problem, which is to extract ...
research
04/29/2016

Sparse Generalized Eigenvalue Problem: Optimal Statistical Rates via Truncated Rayleigh Flow

Sparse generalized eigenvalue problem plays a pivotal role in a large fa...
research
03/24/2021

Analysis of Truncated Orthogonal Iteration for Sparse Eigenvector Problems

A wide range of problems in computational science and engineering requir...
research
09/09/2020

Solving the k-sparse Eigenvalue Problem with Reinforcement Learning

We examine the possibility of using a reinforcement learning (RL) algori...
research
11/08/2017

Penalized Orthogonal Iteration for Sparse Estimation of Generalized Eigenvalue Problem

We propose a new algorithm for sparse estimation of eigenvectors in gene...
research
02/26/2018

A Decomposition Algorithm for Sparse Generalized Eigenvalue Problem

Sparse generalized eigenvalue problem arises in a number of standard and...

Please sign up or login with your details

Forgot password? Click here to reset