On the Kullback-Leibler divergence between pairwise isotropic Gaussian-Markov random fields

03/24/2022
by   Alexandre L. M. Levada, et al.
0

The Kullback-Leibler divergence or relative entropy is an information-theoretic measure between statistical models that play an important role in measuring a distance between random variables. In the study of complex systems, random fields are mathematical structures that models the interaction between these variables by means of an inverse temperature parameter, responsible for controlling the spatial dependence structure along the field. In this paper, we derive closed-form expressions for the Kullback-Leibler divergence between two pairwise isotropic Gaussian-Markov random fields in both univariate and multivariate cases. The proposed equation allows the development of novel similarity measures in image processing and machine learning applications, such as image denoising and unsupervised metric learning.

READ FULL TEXT

page 3

page 5

research
01/15/2021

Learning to Sample from Censored Markov Random Fields

We study learning Censor Markov Random Fields (abbreviated CMRFs). These...
research
08/25/2011

Learning from Complex Systems: On the Roles of Entropy and Fisher Information in Pairwise Isotropic Gaussian Markov Random Fields

Markov Random Field models are powerful tools for the study of complex s...
research
01/30/2022

The Circular Matern Covariance Function and its Link to Markov Random Fields on the Circle

The link between Gaussian random fields and Markov random fields is well...
research
05/30/2020

Inference tools for Markov Random Fields on lattices: The R package mrf2d

Markov random fields on two-dimensional lattices are behind many image a...
research
07/03/2018

Structure Learning of Markov Random Fields through Grow-Shrink Maximum Pseudolikelihood Estimation

Learning the structure of Markov random fields (MRFs) plays an important...
research
07/22/2014

Tree-based iterated local search for Markov random fields with applications in image analysis

The maximum a posteriori (MAP) assignment for general structure Markov r...
research
11/06/2021

Geodesic curves in Gaussian random field manifolds

Random fields are mathematical structures used to model the spatial inte...

Please sign up or login with your details

Forgot password? Click here to reset