DeepAI AI Chat
Log In Sign Up

Ising Model Selection Using ℓ_1-Regularized Linear Regression

by   Xiangming Meng, et al.

We theoretically investigate the performance of ℓ_1-regularized linear regression (ℓ_1-LinR) for the problem of Ising model selection using the replica method from statistical mechanics. The regular random graph is considered under paramagnetic assumption. Our results show that despite model misspecification, the ℓ_1-LinR estimator can successfully recover the graph structure of the Ising model with N variables using M=𝒪(log N) samples, which is of the same order as that of ℓ_1-regularized logistic regression. Moreover, we provide a computationally efficient method to accurately predict the non-asymptotic performance of the ℓ_1-LinR estimator with moderate M and N. Simulations show an excellent agreement between theoretical predictions and experimental results, which supports our findings.


page 1

page 2

page 3

page 4


A Model Free Perspective for Linear Regression: Uniform-in-model Bounds for Post Selection Inference

For the last two decades, high-dimensional data and methods have prolife...

Structure Learning in Inverse Ising Problems Using ℓ_2-Regularized Linear Estimator

Inferring interaction parameters from observed data is a ubiquitous requ...

Meta Learning for High-dimensional Ising Model Selection Using ℓ_1-regularized Logistic Regression

In this paper, we consider the meta learning problem for estimating the ...

Error Analysis on Graph Laplacian Regularized Estimator

We provide a theoretical analysis of the representation learning problem...

A linearization for stable and fast geographically weighted Poisson regression

Although geographically weighted Poisson regression (GWPR) is a popular ...

Kernel Selection for Modal Linear Regression: Optimal Kernel and IRLS Algorithm

Modal linear regression (MLR) is a method for obtaining a conditional mo...