DeepAI
Log In Sign Up

Generalized Self-concordant Hessian-barrier algorithms

11/04/2019
by   Pavel Dvurechensky, et al.
0

Many problems in statistical learning, imaging, and computer vision involve the optimization of a non-convex objective function with singularities at the boundary of the feasible set. For such challenging instances, we develop a new interior-point technique building on the Hessian-barrier algorithm recently introduced in Bomze, Mertikopoulos, Schachinger and Staudigl, [SIAM J. Opt. 2019 29(3), pp. 2100-2127], where the Riemannian metric is induced by a generalized self-concordant function. This class of functions is sufficiently general to include most of the commonly used barrier functions in the literature of interior point methods. We prove global convergence to an approximate stationary point of the method, and in cases where the feasible set admits an easily computable self-concordant barrier, we verify worst-case optimal iteration complexity of the method. Applications in non-convex statistical estimation and L^p-minimization are discussed to given the efficiency of the method.

READ FULL TEXT

page 1

page 2

page 3

page 4

12/21/2021

The entropic barrier is n-self-concordant

For any convex body K ⊆ℝ^n, S. Bubeck and R. Eldan introduced the entrop...
09/25/2018

Hessian barrier algorithms for linearly constrained optimization problems

In this paper, we propose an interior-point method for linearly constrai...
03/04/2019

A Stochastic Trust Region Method for Non-convex Minimization

We target the problem of finding a local minimum in non-convex finite-su...
01/06/2022

No self-concordant barrier interior point method is strongly polynomial

It is an open question to determine if the theory of self-concordant bar...
11/02/2022

Quasi-Newton Steps for Efficient Online Exp-Concave Optimization

The aim of this paper is to design computationally-efficient and optimal...
05/23/2018

Interior Point Methods with Adversarial Networks

We present a new methodology, called IPMAN, that combines interior point...
12/09/2020

Dual perspective method for solving the point in a polygon problem

A novel method has been introduced to solve a point inclusion in a polyg...