DeepAI AI Chat
Log In Sign Up

Mesh-Based Solutions for Nonparametric Penalized Regression

by   Brayan Ortiz, et al.

It is often of interest to estimate regression functions non-parametrically. Penalized regression (PR) is one statistically-effective, well-studied solution to this problem. Unfortunately, in many cases, finding exact solutions to PR problems is computationally intractable. In this manuscript, we propose a mesh-based approximate solution (MBS) for those scenarios. MBS transforms the complicated functional minimization of NPR, to a finite parameter, discrete convex minimization; and allows us to leverage the tools of modern convex optimization. We show applications of MBS in a number of explicit examples (including both uni- and multi-variate regression), and explore how the number of parameters must increase with our sample-size in order for MBS to maintain the rate-optimality of NPR. We also give an efficient algorithm to minimize the MBS objective while effectively leveraging the sparsity inherent in MBS.


page 1

page 2

page 3

page 4


An efficient ADMM algorithm for high dimensional precision matrix estimation via penalized quadratic loss

The estimation of high dimensional precision matrices has been a central...

HiQR: An efficient algorithm for high dimensional quadratic regression with penalties

This paper investigates the efficient solution of penalized quadratic re...

Sparse Tensor Additive Regression

Tensors are becoming prevalent in modern applications such as medical im...

Regression in Tensor Product Spaces by the Method of Sieves

Estimation of a conditional mean (linking a set of features to an outcom...

Distributed Sparse Regression via Penalization

We study sparse linear regression over a network of agents, modeled as a...

Slowly Varying Regression under Sparsity

We consider the problem of parameter estimation in slowly varying regres...

Solving Equations of Random Convex Functions via Anchored Regression

We consider the question of estimating a solution to a system of equatio...