Panda: AdaPtive Noisy Data Augmentation for Regularization of Undirected Graphical Models

10/11/2018
by   Yinan Li, et al.
0

We propose PANDA, an AdaPtive Noise Augmentation technique to regularize estimating and constructing undirected graphical models (UGMs). PANDA iteratively solves MLEs given noise augmented data in the regression-based framework until convergence to achieve the designed regularization effects. The augmented noises can be designed to achieve various regularization effects on graph estimation, including the bridge, elastic net, adaptive lasso, and SCAD penalization; it can also offer group lasso and fused ridge when some nodes belong to the same group. We establish theoretically that the noise-augmented loss functions and its minimizer converge almost surely to the expected penalized loss function and its minimizer, respectively. We derive the asymptotic distributions for the regularized regression coefficients through PANDA in GLMs, based on which, the inferences for the parameters can be obtained simultaneously with variable selection. Our empirical results suggest the inferences achieve nominal or near-nominal coverage and are far more efficient compared to some existing post-selection procedures. On the algorithm level, PANDA can be easily programmed in any standard software without resorting to complicated optimization techniques. We show the non-inferior performance of PANDA in constructing graphs of different types in simulation studies and also apply PANDA to the autism spectrum disorder data to construct a mixed-node graph.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/18/2022

Adaptive Noisy Data Augmentation for Regularized Estimation and Inference in Generalized Linear Models

We propose the AdaPtive Noise Augmentation (PANDA) procedure to regulari...
research
10/19/2018

AdaPtive Noisy Data Augmentation (PANDA) for Simultaneous Construction Multiple Graph Models

We extend the data augmentation technique (PANDA) by Li et al. (2018) fo...
research
10/20/2021

Variable selection in doubly truncated regression

Doubly truncated data arise in many areas such as astronomy, econometric...
research
05/18/2018

Bayesian Joint Spike-and-Slab Graphical Lasso

In this article, we propose a new class of priors for Bayesian inference...
research
03/28/2022

A Comparison of Hamming Errors of Representative Variable Selection Methods

Lasso is a celebrated method for variable selection in linear models, bu...
research
10/27/2014

Topology Adaptive Graph Estimation in High Dimensions

We introduce Graphical TREX (GTREX), a novel method for graph estimation...
research
03/09/2018

Joint Estimation and Inference for Data Integration Problems based on Multiple Multi-layered Gaussian Graphical Models

The rapid development of high-throughput technologies has enabled the ge...

Please sign up or login with your details

Forgot password? Click here to reset