On a fixed-point continuation method for a convex optimization problem

12/23/2022
by   Jean-Baptiste Fest, et al.
0

We consider a variation of the classical proximal-gradient algorithm for the iterative minimization of a cost function consisting of a sum of two terms, one smooth and the other prox-simple, and whose relative weight is determined by a penalty parameter. This so-called fixed-point continuation method allows one to approximate the problem's trade-off curve, i.e. to compute the minimizers of the cost function for a whole range of values of the penalty parameter at once. The algorithm is shown to converge, and a rate of convergence of the cost function is also derived. Furthermore, it is shown that this method is related to iterative algorithms constructed on the basis of the ϵ-subdifferential of the prox-simple term. Some numerical examples are provided.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/13/2019

Non-convex optimization via strongly convex majoirziation-minimization

In this paper, we introduce a class of nonsmooth nonconvex least square ...
research
09/20/2023

Multiplying poles to avoid unwanted points in root finding and optimization

In root finding and optimization, there are many cases where there is a ...
research
10/21/2020

Improving the Iterative Closest Point Algorithm using Lie Algebra

Mapping algorithms that rely on registering point clouds inevitably suff...
research
03/12/2018

Accuracy-Reliability Cost Function for Empirical Variance Estimation

In this paper we focus on the problem of assigning uncertainties to sing...
research
10/05/2013

Contraction Principle based Robust Iterative Algorithms for Machine Learning

Iterative algorithms are ubiquitous in the field of data mining. Widely ...
research
09/18/2019

Fixed Point Analysis of Douglas-Rachford Splitting for Ptychography and Phase Retrieval

Douglas-Rachford Splitting (DRS) methods based on the proximal point alg...
research
03/11/2015

L_1-regularized Boltzmann machine learning using majorizer minimization

We propose an inference method to estimate sparse interactions and biase...

Please sign up or login with your details

Forgot password? Click here to reset