DeepAI AI Chat
Log In Sign Up

Penalized Interaction Estimation for Ultrahigh Dimensional Quadratic Regression

by   Cheng Wang, et al.
Renmin University of China
Shanghai Jiao Tong University
The Hong Kong Polytechnic University

Quadratic regression goes beyond the linear model by simultaneously including main effects and interactions between the covariates. The problem of interaction estimation in high dimensional quadratic regression has received extensive attention in the past decade. In this article we introduce a novel method which allows us to estimate the main effects and interactions separately. Unlike existing methods for ultrahigh dimensional quadratic regressions, our proposal does not require the widely used heredity assumption. In addition, our proposed estimates have explicit formulas and obey the invariance principle at the population level. We estimate the interactions of matrix form under penalized convex loss function. The resulting estimates are shown to be consistent even when the covariate dimension is an exponential order of the sample size. We develop an efficient ADMM algorithm to implement the penalized estimation. This ADMM algorithm fully explores the cheap computational cost of matrix multiplication and is much more efficient than existing penalized methods such as all pairs LASSO. We demonstrate the promising performance of our proposal through extensive numerical studies.


HiQR: An efficient algorithm for high dimensional quadratic regression with penalties

This paper investigates the efficient solution of penalized quadratic re...

An efficient ADMM algorithm for high dimensional precision matrix estimation via penalized quadratic loss

The estimation of high dimensional precision matrices has been a central...

Lasso and equivalent quadratic penalized models

The least absolute shrinkage and selection operator (lasso) and ridge re...

A Unified Algorithm for Penalized Convolution Smoothed Quantile Regression

Penalized quantile regression (QR) is widely used for studying the relat...

Hierarchical Total Variations and Doubly Penalized ANOVA Modeling for Multivariate Nonparametric Regression

For multivariate nonparametric regression, functional analysis-of-varian...

Interaction Hard Thresholding: Consistent Sparse Quadratic Regression in Sub-quadratic Time and Space

Quadratic regression involves modeling the response as a (generalized) l...