Misspecification Analysis of High-Dimensional Random Effects Models for Estimation of Signal-to-Noise Ratios

02/13/2022
by   Xiaohan Hu, et al.
0

Estimation of signal-to-noise ratios and noise variances in high-dimensional linear models have important applications in statistical inference, hyperparameter selection, and heritability estimation in genomics. One common approach in practice is maximum likelihood estimation under random effects models. This paper aims to conduct model misspecification analysis on the consistency of this method, in which the true model only has fixed effects. Assume that the ratio between the number of samples and features converges to a nonzero constant, our results provide conditions on the design matrices under which random effects model based maximum likelihood estimation is asymptotically consistent in estimating the SNR and noise variance. Our model misspecification analysis also extends to the high-dimensional linear models with feature groups, in which group SNR estimation has important applications such as tuning parameter selection for group ridge regression.

READ FULL TEXT
research
08/03/2023

The use of the EM algorithm for regularization problems in high-dimensional linear mixed-effects models

The EM algorithm is a popular tool for maximum likelihood estimation but...
research
12/16/2019

Statistical significance in high-dimensional linear mixed models

This paper concerns the development of an inferential framework for high...
research
11/21/2020

Phase transition of graph Laplacian of high dimensional noisy random point cloud

We systematically explore the spectral distribution of kernel-based grap...
research
01/16/2020

A Support Detection and Root Finding Approach for Learning High-dimensional Generalized Linear Models

Feature selection is important for modeling high-dimensional data, where...
research
10/06/2019

Convex and Non-convex Approaches for Statistical Inference with Noisy Labels

We study the problem of estimation and testing in logistic regression wi...
research
07/02/2021

Maximum likelihood for high-noise group orbit estimation and single-particle cryo-EM

Motivated by applications to single-particle cryo-electron microscopy (c...
research
03/10/2017

High SNR Consistent Compressive Sensing

High signal to noise ratio (SNR) consistency of model selection criteria...

Please sign up or login with your details

Forgot password? Click here to reset