Approximate Primal-Dual Fixed-Point based Langevin Algorithms for Non-smooth Convex Potentials

04/10/2023
by   Ziruo Cai, et al.
0

The Langevin algorithms are frequently used to sample the posterior distributions in Bayesian inference. In many practical problems, however, the posterior distributions often consist of non-differentiable components, posing challenges for the standard Langevin algorithms, as they require to evaluate the gradient of the energy function in each iteration. To this end, a popular remedy is to utilize the proximity operator, and as a result one needs to solve a proximity subproblem in each iteration. The conventional practice is to solve the subproblems accurately, which can be exceedingly expensive, as the subproblem needs to be solved in each iteration. We propose an approximate primal-dual fixed-point algorithm for solving the subproblem, which only seeks an approximate solution of the subproblem and therefore reduces the computational cost considerably. We provide theoretical analysis of the proposed method and also demonstrate its performance with numerical examples.

READ FULL TEXT

page 19

page 23

research
01/01/2022

On the improved conditions for some primal-dual algorithms

The convex minimization of f(𝐱)+g(𝐱)+h(𝐀𝐱) over ℝ^n with differentiable ...
research
11/18/2017

A primal-dual algorithm with optimal stepsizes and its application in decentralized consensus optimization

We consider a primal-dual algorithm for minimizing f(x)+h(Ax) with diffe...
research
01/13/2022

Chambolle-Pock's Primal-Dual Method with Mismatched Adjoint

The primal-dual method of Chambolle and Pock is a widely used algorithm ...
research
06/10/2022

Inverting Incomplete Fourier Transforms by a Sparse Regularization Model and Applications in Seismic Wavefield Modeling

We propose a sparse regularization model for inversion of incomplete Fou...
research
04/29/2021

Feasibility-based Fixed Point Networks

Inverse problems consist of recovering a signal from a collection of noi...
research
02/07/2020

Differentiable Fixed-Point Iteration Layer

Recently, several studies proposed methods to utilize some restricted cl...
research
12/15/2014

Fixed Point Algorithm Based on Quasi-Newton Method for Convex Minimization Problem with Application to Image Deblurring

Solving an optimization problem whose objective function is the sum of t...

Please sign up or login with your details

Forgot password? Click here to reset