HiQR: An efficient algorithm for high dimensional quadratic regression with penalties

06/01/2023
by   Cheng Wang, et al.
0

This paper investigates the efficient solution of penalized quadratic regressions in high-dimensional settings. We propose a novel and efficient algorithm for ridge-penalized quadratic regression that leverages the matrix structures of the regression with interactions. Building on this formulation, we develop an alternating direction method of multipliers (ADMM) framework for penalized quadratic regression with general penalties, including both single and hybrid penalty functions. Our approach greatly simplifies the calculations to basic matrix-based operations, making it appealing in terms of both memory storage and computational complexity.

READ FULL TEXT
research
11/12/2018

An efficient ADMM algorithm for high dimensional precision matrix estimation via penalized quadratic loss

The estimation of high dimensional precision matrices has been a central...
research
01/22/2019

Penalized Interaction Estimation for Ultrahigh Dimensional Quadratic Regression

Quadratic regression goes beyond the linear model by simultaneously incl...
research
01/23/2019

High-dimensional Interactions Detection with Sparse Principal Hessian Matrix

In statistical methods, interactions are the contributions from the prod...
research
12/07/2021

Mesh-Based Solutions for Nonparametric Penalized Regression

It is often of interest to estimate regression functions non-parametrica...
research
01/10/2014

Lasso and equivalent quadratic penalized models

The least absolute shrinkage and selection operator (lasso) and ridge re...
research
03/03/2021

Ridge-penalized adaptive Mantel test and its application in imaging genetics

We propose a ridge-penalized adaptive Mantel test (AdaMant) for evaluati...
research
06/27/2020

The flare Package for High Dimensional Linear Regression and Precision Matrix Estimation in R

This paper describes an R package named flare, which implements a family...

Please sign up or login with your details

Forgot password? Click here to reset