A spectral characterization and an approximation scheme for the Hessian eigenvalue

12/14/2020
by   Nam Q. Le, et al.
0

We revisit the k-Hessian eigenvalue problem on a smooth, bounded, (k-1)-convex domain in ℝ^n. First, we obtain a spectral characterization of the k-Hessian eigenvalue as the infimum of the first eigenvalues of linear second-order elliptic operators whose coefficients belong to the dual of the corresponding Gårding cone. Second, we introduce a non-degenerate inverse iterative scheme to solve the eigenvalue problem for the k-Hessian operator. We show that the scheme converges, with a rate, to the k-Hessian eigenvalue for all k. When 2≤ k≤ n, we also prove a local L^1 convergence of the Hessian of solutions of the scheme. Hyperbolic polynomials play an important role in our analysis.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/22/2016

Eigenvalues of the Hessian in Deep Learning: Singularity and Beyond

We look at the eigenvalues of the Hessian of a loss function before and ...
research
03/02/2021

Hessian Eigenspectra of More Realistic Nonlinear Models

Given an optimization problem, the Hessian matrix and its eigenspectrum ...
research
10/15/2019

Adjoint-based exact Hessian-vector multiplication using symplectic Runge–Kutta methods

We consider a function of the numerical solution of an initial value pro...
research
10/05/2019

Inverse norm estimation of perturbed Laplace operators and corresponding eigenvalue problems

The purpose of this paper is to reveal an eigenvalue problem correspondi...
research
01/23/2023

(Non)-penalized Multilevel methods for non-uniformly log-concave distributions

We study and develop multilevel methods for the numerical approximation ...
research
12/02/2019

On the Delta Method for Uncertainty Approximation in Deep Learning

The Delta method is a well known procedure used to quantify uncertainty ...
research
05/16/2023

The Average Rate of Convergence of the Exact Line Search Gradient Descent Method

It is very well-known that when the exact line search gradient descent m...

Please sign up or login with your details

Forgot password? Click here to reset