Second order semi-smooth Proximal Newton methods in Hilbert spaces

03/26/2021
by   Bastian Pötzl, et al.
0

We develop a globalized Proximal Newton method for composite and possibly non-convex minimization problems in Hilbert spaces. Additionally, we impose less restrictive assumptions on the composite objective functional considering differentiability and convexity than in existing theory. As far as differentiability of the smooth part of the objective function is concerned, we introduce the notion of second order semi-smoothness and discuss why it constitutes an adequate framework for our Proximal Newton method. However, both global convergence as well as local acceleration still pertain to hold in our scenario. Eventually, the convergence properties of our algorithm are displayed by solving a toy model problem in function space.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/31/2016

A Proximal Stochastic Quasi-Newton Algorithm

In this paper, we discuss the problem of minimizing the sum of two conve...
research
03/14/2017

Generalized Self-Concordant Functions: A Recipe for Newton-Type Methods

We study the smooth structure of convex functions by generalizing a powe...
research
04/22/2019

Provable Bregman-divergence based Methods for Nonconvex and Non-Lipschitz Problems

The (global) Lipschitz smoothness condition is crucial in establishing t...
research
12/04/2019

Stochastic proximal splitting algorithm for stochastic composite minimization

Supported by the recent contributions in multiple branches, the first-or...
research
12/06/2022

Proximal methods for point source localisation

Point source localisation is generally modelled as a Lasso-type problem ...
research
04/27/2023

Convexity Not Required: Estimation of Smooth Moment Condition Models

Generalized and Simulated Method of Moments are often used to estimate s...
research
07/01/2018

Stochastic model-based minimization under high-order growth

Given a nonsmooth, nonconvex minimization problem, we consider algorithm...

Please sign up or login with your details

Forgot password? Click here to reset