SuperDC: Stable superfast divide-and-conquer eigenvalue decomposition

08/09/2021
by   Xiaofeng Ou, et al.
0

For dense Hermitian matrices with small off-diagonal (numerical) ranks and in a hierarchically semiseparable form, we give a stable divide-and-conquer eigendecomposition method with nearly linear complexity (called SuperDC) that significantly improves an earlier basic algorithm in [Vogel, Xia, et al., SIAM J. Sci. Comput., 38 (2016)]. We incorporate a sequence of key stability techniques and provide many improvements in the algorithm design. Various stability risks in the original algorithm are analyzed, including potential exponential norm growth, cancellations, loss of accuracy with clustered eigenvalues or intermediate eigenvalues, etc. In the dividing stage, we give a new structured low-rank update strategy with balancing that eliminates the exponential norm growth and also minimizes the ranks of low-rank updates. In the conquering stage with low-rank updated eigenvalue solution, the original algorithm directly uses the regular fast multipole method (FMM) to accelerate function evaluations, which has the risks of cancellation, division by zero, and slow convergence. Here, we design a triangular FMM to avoid cancellation. Furthermore, when there are clustered intermediate eigenvalues or when updates to existing eigenvalues are very small, we design a novel local shifting strategy to integrate FMM accelerations into the solution of shifted secular equations so as to achieve both the efficiency and the reliability. We also provide several improvements or clarifications on some structures and techniques that are missing or unclear in the previous work. The resulting SuperDC eigensolver has significantly better stability while keeping the nearly linear complexity for finding the entire eigenvalue decomposition. In a set of comprehensive tests, SuperDC shows dramatically lower runtime and storage, and more stability advantages than the Matlab function.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/22/2023

Analysis of a class of randomized numerical methods for singular matrix pencils

The numerical solution of the generalized eigenvalue problem for a singu...
research
03/06/2019

Low-rank updates and divide-and-conquer methods for quadratic matrix equations

In this work, we consider two types of large-scale quadratic matrix equa...
research
02/12/2020

Fast computation of optimal damping parameters for linear vibrational systems

We formulate the quadratic eigenvalue problem underlying the mathematica...
research
10/21/2022

Analysis of GMRES for Low-Rank and Small-Norm Perturbations of the Identity Matrix

In many applications, linear systems arise where the coefficient matrix ...
research
03/06/2021

Low-Rank Isomap Algorithm

The Isomap is a well-known nonlinear dimensionality reduction method tha...
research
06/17/2020

A simple extrapolation method for clustered eigenvalues

This paper introduces a simple variant of the power method. It is shown ...
research
04/26/2022

Nonlinear eigenvalue methods for linear pointwise stability of nonlinear waves

We propose an iterative method to find pointwise growth exponential grow...

Please sign up or login with your details

Forgot password? Click here to reset