Weighted Lasso Estimates for Sparse Logistic Regression: Non-asymptotic Properties with Measurement Error

06/11/2020
by   Huamei Huang, et al.
0

When we are interested in high-dimensional system and focus on classification performance, the ℓ_1-penalized logistic regression is becoming important and popular. However, the Lasso estimates could be problematic when penalties of different coefficients are all the same and not related to the data. We proposed two types of weighted Lasso estimates depending on covariates by the McDiarmid inequality. Given sample size n and dimension of covariates p, the finite sample behavior of our proposed methods with a diverging number of predictors is illustrated by non-asymptotic oracle inequalities such as ℓ_1-estimation error and squared prediction error of the unknown parameters. We compare the performance of our methods with former weighted estimates on simulated data, then apply these methods to do real data analysis.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/29/2011

Estimation And Selection Via Absolute Penalized Convex Minimization And Its Multistage Adaptive Applications

The ℓ_1-penalized method, or the Lasso, has emerged as an important tool...
research
08/20/2021

Robust adaptive Lasso in high-dimensional logistic regression with an application to genomic classification of cancer patients

Penalized logistic regression is extremely useful for binary classificat...
research
02/20/2023

Conformal Prediction for Network-Assisted Regression

An important problem in network analysis is predicting a node attribute ...
research
12/14/2022

On LASSO for High Dimensional Predictive Regression

In a high dimensional linear predictive regression where the number of p...
research
12/18/2020

On the density estimation problem for uncertainty propagation with unknown input distributions

In this article we study the problem of quantifying the uncertainty in a...
research
07/28/2018

Logistic regression and Ising networks: prediction and estimation when violating lasso assumptions

The Ising model was originally developed to model magnetisation of solid...
research
03/20/2019

Omitted variable bias of Lasso-based inference methods under limited variability: A finite sample analysis

We study the finite sample behavior of Lasso and Lasso-based inference m...

Please sign up or login with your details

Forgot password? Click here to reset