Efficient MRF Energy Minimization via Adaptive Diminishing Smoothing

10/16/2012
by   Bogdan Savchynskyy, et al.
0

We consider the linear programming relaxation of an energy minimization problem for Markov Random Fields. The dual objective of this problem can be treated as a concave and unconstrained, but non-smooth function. The idea of smoothing the objective prior to optimization was recently proposed in a series of papers. Some of them suggested the idea to decrease the amount of smoothing (so called temperature) while getting closer to the optimum. However, no theoretical substantiation was provided. We propose an adaptive smoothing diminishing algorithm based on the duality gap between relaxed primal and dual objectives and demonstrate the efficiency of our approach with a smoothed version of Sequential Tree-Reweighted Message Passing (TRW-S) algorithm. The strategy is applicable to other algorithms as well, avoids adhoc tuning of the smoothing during iterations, and provably guarantees convergence to the optimum.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/20/2014

A Primal-Dual Algorithmic Framework for Constrained Convex Minimization

We present a primal-dual algorithmic framework to obtain approximate sol...
research
09/05/2018

Solving Non-smooth Constrained Programs with Lower Complexity than O(1/ε): A Primal-Dual Homotopy Smoothing Approach

We propose a new primal-dual homotopy smoothing algorithm for a linearly...
research
07/01/2020

Accelerated Message Passing for Entropy-Regularized MAP Inference

Maximum a posteriori (MAP) inference in discrete-valued Markov random fi...
research
03/01/2017

Dual Iterative Hard Thresholding: From Non-convex Sparse Minimization to Non-smooth Concave Maximization

Iterative Hard Thresholding (IHT) is a class of projected gradient desce...
research
06/20/2012

Convergent Propagation Algorithms via Oriented Trees

Inference problems in graphical models are often approximated by casting...
research
07/13/2016

Homotopy Smoothing for Non-Smooth Problems with Lower Complexity than O(1/ε)

In this paper, we develop a novel homoto py smoothing (HOPS) algorithm...
research
01/21/2022

Unity Smoothing for Handling Inconsistent Evidence in Bayesian Networks and Unity Propagation for Faster Inference

We propose Unity Smoothing (US) for handling inconsistencies between a B...

Please sign up or login with your details

Forgot password? Click here to reset