High-dimensional Interactions Detection with Sparse Principal Hessian Matrix

01/23/2019
by   Cheng Yong Tang, et al.
0

In statistical methods, interactions are the contributions from the products of the predictor variables to the response variable. In high-dimensional problems, detecting interactions is challenging due to the combinatorial complexity in conjunction with limited data information. We consider detecting interactions by exploring their connections with the principal Hessian matrix. To handle the challenging high dimensionality, a one-step synthetic approach is proposed to estimate the principal Hessian matrix by a penalized M-estimator. An alternating direction method of multipliers (ADMM) is proposed to efficiently solve the encountered regularized optimizations. Based on the sparse estimator, we propose a new method to detect the interactions by identifying the nonzero components. Our method directly targets at the interactions, and it requires no structural assumption on the hierarchy between the interactions effects and those from the original predictor variables. We show that our estimator is theoretically valid, computationally efficient, and practically useful for detecting the interactions in a broad spectrum of scenarios.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/30/2020

Impulse Response Analysis for Sparse High-Dimensional Time Series

We consider structural impulse response analysis for sparse high-dimensi...
research
06/01/2023

HiQR: An efficient algorithm for high dimensional quadratic regression with penalties

This paper investigates the efficient solution of penalized quadratic re...
research
06/24/2022

Efficient Penalized Generalized Linear Mixed Models for Variable Selection and Genetic Risk Prediction in High-Dimensional Data

Sparse regularized regression methods are now widely used in genome-wide...
research
02/23/2012

Optimal detection of sparse principal components in high dimension

We perform a finite sample analysis of the detection levels for sparse p...
research
10/01/2015

QUDA: A Direct Approach for Sparse Quadratic Discriminant Analysis

Quadratic discriminant analysis (QDA) is a standard tool for classificat...
research
03/22/2023

Convergence of Hessian estimator from random samples on a manifold

We provide a systematic convergence analysis of the Hessian operator est...
research
01/24/2019

Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians

We consider deep classifying neural networks. We expose a structure in t...

Please sign up or login with your details

Forgot password? Click here to reset