Oracle inequalities for sign constrained generalized linear models

11/09/2017
by   Yuta Koike, et al.
0

High-dimensional data have recently been analyzed because of data collection technology evolution. Although many methods have been developed to gain sparse recovery in the past two decades, most of these methods require selection of tuning parameters. As a consequence of this feature, results obtained with these methods heavily depend on the tuning. In this paper we study the theoretical properties of sign-constrained generalized linear models with convex loss function, which is one of the sparse regression methods without tuning parameters. Recent studies on this topic have shown that, in the case of linear regression, sign-constrains alone could be as efficient as the oracle method if the design matrix enjoys a suitable assumption in addition to a traditional compatibility condition. We generalize this kind of result to a much more general model which encompasses the logistic and quantile regressions. We also perform some numerical experiments to confirm theoretical findings obtained in this paper.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/31/2020

On regularization methods based on Rényi's pseudodistances for sparse high-dimensional linear regression models

Several regularization methods have been considered over the last decade...
research
10/22/2012

Strong oracle optimality of folded concave penalized estimation

Folded concave penalization methods have been shown to enjoy the strong ...
research
06/13/2019

Distributed High-dimensional Regression Under a Quantile Loss Function

This paper studies distributed estimation and support recovery for high-...
research
09/12/2023

A Consistent and Scalable Algorithm for Best Subset Selection in Single Index Models

Analysis of high-dimensional data has led to increased interest in both ...
research
11/16/2009

Kullback-Leibler aggregation and misspecified generalized linear models

In a regression setup with deterministic design, we study the pure aggre...
research
10/26/2022

High-dimensional Measurement Error Models for Lipschitz Loss

Recently emerging large-scale biomedical data pose exciting opportunitie...
research
09/09/2019

Robust testing in generalized linear models by sign-flipping score contributions

Generalized linear models are often misspecified due to overdispersion, ...

Please sign up or login with your details

Forgot password? Click here to reset