Solving Non-parametric Inverse Problem in Continuous Markov Random Field using Loopy Belief Propagation

03/28/2017

∙

In this paper, we address the inverse problem, or the statistical machine learning problem, in Markov random fields with a non-parametric pair-wise energy function with continuous variables. The inverse problem is formulated by maximum likelihood estimation. The exact treatment of maximum likelihood estimation is intractable because of two problems: (1) it includes the evaluation of the partition function and (2) it is formulated in the form of functional optimization. We avoid Problem (1) by using Bethe approximation. Bethe approximation is an approximation technique equivalent to the loopy belief propagation. Problem (2) can be solved by using orthonormal function expansion. Orthonormal function expansion can reduce a functional optimization problem to a function optimization problem. Our method can provide an analytic form of the solution of the inverse problem within the framework of Bethe approximation.

READ FULL TEXT

Solving Non-parametric Inverse Problem in Continuous Markov Random Field using Loopy Belief Propagation

Bethe Learning of Conditional Random Fields via MAP Decoding

Uncertainty estimation in equality-constrained MAP and maximum likelihood estimation with applications to system identification and state estimation

Loop corrections in spin models through density consistency

Optimistic Distributionally Robust Optimization for Nonparametric Likelihood Approximation

Discrete Optimization of Ray Potentials for Semantic 3D Reconstruction

Efficient Inference of Spatially-varying Gaussian Markov Random Fields with Applications in Gene Regulatory Networks

Scalable Inference of Sparsely-changing Markov Random Fields with Strong Statistical Guarantees

Solving Non-parametric Inverse Problem in Continuous Markov Random Field using Loopy Belief Propagation

Related Research

Bethe Learning of Conditional Random Fields via MAP Decoding

Uncertainty estimation in equality-constrained MAP and maximum likelihood estimation with applications to system identification and state estimation

Loop corrections in spin models through density consistency

Optimistic Distributionally Robust Optimization for Nonparametric Likelihood Approximation

Discrete Optimization of Ray Potentials for Semantic 3D Reconstruction

Efficient Inference of Spatially-varying Gaussian Markov Random Fields with Applications in Gene Regulatory Networks

Scalable Inference of Sparsely-changing Markov Random Fields with Strong Statistical Guarantees