Vector-Space Markov Random Fields via Exponential Families

05/19/2015
by   Wesley Tansey, et al.
0

We present Vector-Space Markov Random Fields (VS-MRFs), a novel class of undirected graphical models where each variable can belong to an arbitrary vector space. VS-MRFs generalize a recent line of work on scalar-valued, uni-parameter exponential family and mixed graphical models, thereby greatly broadening the class of exponential families available (e.g., allowing multinomial and Dirichlet distributions). Specifically, VS-MRFs are the joint graphical model distributions where the node-conditional distributions belong to generic exponential families with general vector space domains. We also present a sparsistent M-estimator for learning our class of MRFs that recovers the correct set of edges with high probability. We validate our approach via a set of synthetic data experiments as well as a real-world case study of over four million foods from the popular diet tracking app MyFitnessPal. Our results demonstrate that our algorithm performs well empirically and that VS-MRFs are capable of capturing and highlighting interesting structure in complex, real-world data. All code for our algorithm is open source and publicly available.

READ FULL TEXT

Authors

page 1

page 2

page 3

page 4

01/17/2013

On Graphical Models via Univariate Exponential Family Distributions

Undirected graphical models, or Markov networks, are a popular class of ...
11/02/2014

A General Framework for Mixed Graphical Models

"Mixed Data" comprising a large number of heterogeneous variables (e.g. ...
07/11/2012

Exponential Families for Conditional Random Fields

In this paper we de ne conditional random elds in reproducing kernel Hil...
05/01/2019

Total positivity in structured binary distributions

We study binary distributions that are multivariate totally positive of ...
05/09/2022

On a wider class of prior distributions for graphical models

Gaussian graphical models are useful tools for conditional independence ...
02/18/2021

Learning Continuous Exponential Families Beyond Gaussian

We address the problem of learning of continuous exponential family dist...
03/11/2020

Gaussian Graphical Model exploration and selection in high dimension low sample size setting

Gaussian Graphical Models (GGM) are often used to describe the condition...

Code Repositories

vsmrfs

Vector-Space Markov Random Fields


view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.