Characterization and estimation of high dimensional sparse regression parameters under linear inequality constraints

02/03/2023
by   Neha Agarwala, et al.
0

Modern statistical problems often involve such linear inequality constraints on model parameters. Ignoring natural parameter constraints usually results in less efficient statistical procedures. To this end, we define a notion of `sparsity' for such restricted sets using lower-dimensional features. We allow our framework to be flexible so that the number of restrictions may be higher than the number of parameters. One such situation arise in estimation of monotone curve using a non parametric approach e.g. splines. We show that the proposed notion of sparsity agrees with the usual notion of sparsity in the unrestricted case and proves the validity of the proposed definition as a measure of sparsity. The proposed sparsity measure also allows us to generalize popular priors for sparse vector estimation to the constrained case.

READ FULL TEXT
research
03/06/2017

On parameters transformations for emulating sparse priors using variational-Laplace inference

So-called sparse estimators arise in the context of model fitting, when ...
research
12/06/2021

Bayesian Estimation Approach for Linear Regression Models with Linear Inequality Restrictions

Univariate and multivariate general linear regression models, subject to...
research
03/14/2022

The Role of Interactivity in Structured Estimation

We study high-dimensional sparse estimation under three natural constrai...
research
03/09/2023

Inequality Restricted Estimator for Gamma Regression: Bayesian approach as a solution to the Multicollinearity

In this paper, we consider the multicollinearity problem in the gamma re...
research
02/16/2023

Reducing Computational and Statistical Complexity in Machine Learning Through Cardinality Sparsity

High-dimensional data has become ubiquitous across the sciences but caus...
research
04/19/2020

Decision Problems in Information Theory

Constraints on entropies are considered to be the laws of information th...
research
10/23/2021

On Parameter Estimation in Unobserved Components Models subject to Linear Inequality Constraints

We propose a new quadratic-programming-based method of approximating a n...

Please sign up or login with your details

Forgot password? Click here to reset