Interaction Screening: Efficient and Sample-Optimal Learning of Ising Models

05/24/2016
by   Marc Vuffray, et al.
0

We consider the problem of learning the underlying graph of an unknown Ising model on p spins from a collection of i.i.d. samples generated from the model. We suggest a new estimator that is computationally efficient and requires a number of samples that is near-optimal with respect to previously established information-theoretic lower-bound. Our statistical estimator has a physical interpretation in terms of "interaction screening". The estimator is consistent and is efficiently implemented using convex optimization. We prove that with appropriate regularization, the estimator recovers the underlying graph using a number of samples that is logarithmic in the system size p and exponential in the maximum coupling-intensity and maximum node-degree.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/13/2019

The Log-Concave Maximum Likelihood Estimator is Optimal in High Dimensions

We study the problem of learning a d-dimensional log-concave distributio...
research
02/12/2018

Region Detection in Markov Random Fields: Gaussian Case

In this work we consider the problem of model selection in Gaussian Mark...
research
03/31/2020

Information-Theoretic Lower Bounds for Zero-Order Stochastic Gradient Estimation

In this paper we analyze the necessary number of samples to estimate the...
research
06/21/2020

Learning of Discrete Graphical Models with Neural Networks

Graphical models are widely used in science to represent joint probabili...
research
02/04/2022

Maximum Likelihood Estimation of Optimal Receiver Operating Characteristic Curves from Likelihood Ratio Observations

The optimal receiver operating characteristic (ROC) curve, giving the ma...
research
05/04/2023

Testing Convex Truncation

We study the basic statistical problem of testing whether normally distr...
research
09/20/2017

Property Testing in High Dimensional Ising models

This paper explores the information-theoretic limitations of graph prope...

Please sign up or login with your details

Forgot password? Click here to reset