Ising Model Selection Using ℓ_1-Regularized Linear Regression

02/08/2021
by   Xiangming Meng, et al.
0

We theoretically investigate the performance of ℓ_1-regularized linear regression (ℓ_1-LinR) for the problem of Ising model selection using the replica method from statistical mechanics. The regular random graph is considered under paramagnetic assumption. Our results show that despite model misspecification, the ℓ_1-LinR estimator can successfully recover the graph structure of the Ising model with N variables using M=𝒪(log N) samples, which is of the same order as that of ℓ_1-regularized logistic regression. Moreover, we provide a computationally efficient method to accurately predict the non-asymptotic performance of the ℓ_1-LinR estimator with moderate M and N. Simulations show an excellent agreement between theoretical predictions and experimental results, which supports our findings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/15/2018

A Model Free Perspective for Linear Regression: Uniform-in-model Bounds for Post Selection Inference

For the last two decades, high-dimensional data and methods have prolife...
research
08/19/2020

Structure Learning in Inverse Ising Problems Using ℓ_2-Regularized Linear Estimator

Inferring interaction parameters from observed data is a ubiquitous requ...
research
09/04/2023

Generalized Information Criteria for Structured Sparse Models

Regularized m-estimators are widely used due to their ability of recover...
research
08/19/2022

Meta Learning for High-dimensional Ising Model Selection Using ℓ_1-regularized Logistic Regression

In this paper, we consider the meta learning problem for estimating the ...
research
02/11/2019

Error Analysis on Graph Laplacian Regularized Estimator

We provide a theoretical analysis of the representation learning problem...
research
05/15/2023

A linearization for stable and fast geographically weighted Poisson regression

Although geographically weighted Poisson regression (GWPR) is a popular ...
research
01/30/2020

Kernel Selection for Modal Linear Regression: Optimal Kernel and IRLS Algorithm

Modal linear regression (MLR) is a method for obtaining a conditional mo...

Please sign up or login with your details

Forgot password? Click here to reset