Vector-Space Markov Random Fields via Exponential Families

by   Wesley Tansey, et al.

We present Vector-Space Markov Random Fields (VS-MRFs), a novel class of undirected graphical models where each variable can belong to an arbitrary vector space. VS-MRFs generalize a recent line of work on scalar-valued, uni-parameter exponential family and mixed graphical models, thereby greatly broadening the class of exponential families available (e.g., allowing multinomial and Dirichlet distributions). Specifically, VS-MRFs are the joint graphical model distributions where the node-conditional distributions belong to generic exponential families with general vector space domains. We also present a sparsistent M-estimator for learning our class of MRFs that recovers the correct set of edges with high probability. We validate our approach via a set of synthetic data experiments as well as a real-world case study of over four million foods from the popular diet tracking app MyFitnessPal. Our results demonstrate that our algorithm performs well empirically and that VS-MRFs are capable of capturing and highlighting interesting structure in complex, real-world data. All code for our algorithm is open source and publicly available.



page 1

page 2

page 3

page 4


On Graphical Models via Univariate Exponential Family Distributions

Undirected graphical models, or Markov networks, are a popular class of ...

A General Framework for Mixed Graphical Models

"Mixed Data" comprising a large number of heterogeneous variables (e.g. ...

Exponential Families for Conditional Random Fields

In this paper we de ne conditional random elds in reproducing kernel Hil...

Total positivity in structured binary distributions

We study binary distributions that are multivariate totally positive of ...

On a wider class of prior distributions for graphical models

Gaussian graphical models are useful tools for conditional independence ...

Learning Continuous Exponential Families Beyond Gaussian

We address the problem of learning of continuous exponential family dist...

Gaussian Graphical Model exploration and selection in high dimension low sample size setting

Gaussian Graphical Models (GGM) are often used to describe the condition...

Code Repositories


Vector-Space Markov Random Fields

view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.