Global Adaptive Generative Adjustment

11/02/2019
by   Bin Wang, et al.
14

Many traditional signal recovery approaches can behave well basing on the penalized likelihood. However, they have to meet with the difficulty in the selection of hyperparameters or tuning parameters in the penalties. In this article, we propose a global adaptive generative adjustment (GAGA) algorithm for signal recovery, in which multiple hyperpameters are automatically learned and alternatively updated with the signal. We further prove that the output of our algorithm directly guarantees the consistency of model selection and the asymptotic normality of signal estimate. Moreover, we also propose a variant GAGA algorithm for improving the computational efficiency in the high-dimensional data analysis. Finally, in the simulated experiment, we consider the consistency of the outputs of our algorithms, and compare our algorithms to other penalized likelihood methods: the Adaptive LASSO, the SCAD and the MCP. The simulation results support the efficiency of our algorithms for signal recovery, and demonstrate that our algorithms outperform the other algorithms.

READ FULL TEXT

page 5

page 6

research
08/23/2013

Likelihood Adaptively Modified Penalties

A new family of penalty functions, adaptive to likelihood, is introduced...
research
11/02/2012

APPLE: Approximate Path for Penalized Likelihood Estimators

In high-dimensional data analysis, penalized likelihood estimators are s...
research
10/05/2018

Asymptotic Confidence Regions Based on the Adaptive Lasso with Partial Consistent Tuning

We construct confidence sets based on an adaptive Lasso estimator with c...
research
07/10/2017

Sparse inference of the drift of a high-dimensional Ornstein-Uhlenbeck process

Given the observation of a high-dimensional Ornstein-Uhlenbeck (OU) proc...
research
07/19/2023

Pattern Recovery in Penalized and Thresholded Estimation and its Geometry

We consider the framework of penalized estimation where the penalty term...
research
04/14/2020

Efficient Least Residual Greedy Algorithms for Sparse Recovery

We present a novel stagewise strategy for improving greedy algorithms fo...
research
02/17/2022

Pattern recovery and signal denoising by SLOPE when the design matrix is orthogonal

Sorted ℓ_1 Penalized Estimator (SLOPE) is a relatively new convex regula...

Please sign up or login with your details

Forgot password? Click here to reset