DeepAI AI Chat
Log In Sign Up

On a fixed-point continuation method for a convex optimization problem

12/23/2022
by   Jean-Baptiste Fest, et al.
0

We consider a variation of the classical proximal-gradient algorithm for the iterative minimization of a cost function consisting of a sum of two terms, one smooth and the other prox-simple, and whose relative weight is determined by a penalty parameter. This so-called fixed-point continuation method allows one to approximate the problem's trade-off curve, i.e. to compute the minimizers of the cost function for a whole range of values of the penalty parameter at once. The algorithm is shown to converge, and a rate of convergence of the cost function is also derived. Furthermore, it is shown that this method is related to iterative algorithms constructed on the basis of the ϵ-subdifferential of the prox-simple term. Some numerical examples are provided.

READ FULL TEXT

page 1

page 2

page 3

page 4

06/13/2019

Non-convex optimization via strongly convex majoirziation-minimization

In this paper, we introduce a class of nonsmooth nonconvex least square ...
09/20/2023

Multiplying poles to avoid unwanted points in root finding and optimization

In root finding and optimization, there are many cases where there is a ...
10/21/2020

Improving the Iterative Closest Point Algorithm using Lie Algebra

Mapping algorithms that rely on registering point clouds inevitably suff...
03/12/2018

Accuracy-Reliability Cost Function for Empirical Variance Estimation

In this paper we focus on the problem of assigning uncertainties to sing...
10/05/2013

Contraction Principle based Robust Iterative Algorithms for Machine Learning

Iterative algorithms are ubiquitous in the field of data mining. Widely ...
09/18/2019

Fixed Point Analysis of Douglas-Rachford Splitting for Ptychography and Phase Retrieval

Douglas-Rachford Splitting (DRS) methods based on the proximal point alg...
03/11/2015

L_1-regularized Boltzmann machine learning using majorizer minimization

We propose an inference method to estimate sparse interactions and biase...