Learning Continuous Exponential Families Beyond Gaussian

02/18/2021
by   Christopher X. Ren, et al.
0

We address the problem of learning of continuous exponential family distributions with unbounded support. While a lot of progress has been made on learning of Gaussian graphical models, we are still lacking scalable algorithms for reconstructing general continuous exponential families modeling higher-order moments of the data beyond the mean and the covariance. Here, we introduce a computationally efficient method for learning continuous graphical models based on the Interaction Screening approach. Through a series of numerical experiments, we show that our estimator maintains similar requirements in terms of accuracy and sample complexity compared to alternative approaches such as maximization of conditional likelihood, while considerably improving upon the algorithm's run-time.

READ FULL TEXT
research
05/01/2019

Total positivity in structured binary distributions

We study binary distributions that are multivariate totally positive of ...
research
01/30/2013

Graphical Models and Exponential Families

We provide a classification of graphical models according to their repre...
research
04/02/2021

Exponential Reduction in Sample Complexity with Learning of Ising Model Dynamics

The usual setting for learning the structure and parameters of a graphic...
research
06/21/2020

Learning of Discrete Graphical Models with Neural Networks

Graphical models are widely used in science to represent joint probabili...
research
03/09/2015

Graphical Exponential Screening

In high dimensions we propose and analyze an aggregation estimator of th...
research
05/19/2015

Vector-Space Markov Random Fields via Exponential Families

We present Vector-Space Markov Random Fields (VS-MRFs), a novel class of...
research
06/12/2020

Sparse and Continuous Attention Mechanisms

Exponential families are widely used in machine learning; they include m...

Please sign up or login with your details

Forgot password? Click here to reset