Rotation to Sparse Loadings using L^p Losses and Related Inference Problems

06/05/2022
by   Xinyi Liu, et al.
0

Exploratory factor analysis (EFA) has been widely used to learn the latent structure underlying multivariate data. Rotation and regularised estimation are two classes of methods in EFA that are widely used to find interpretable loading matrices. This paper proposes a new family of oblique rotations based on component-wise L^p loss functions (0 < p≤ 1) that is closely related to an L^p regularised estimator. Model selection and post-selection inference procedures are developed based on the proposed rotation. When the true loading matrix is sparse, the proposed method tends to outperform traditional rotation and regularised estimation methods, in terms of statistical accuracy and computational cost. Since the proposed loss functions are non-smooth, an iteratively reweighted gradient projection algorithm is developed for solving the optimisation problem. Theoretical results are developed that establish the statistical consistency of the estimation, model selection, and post-selection inference. The proposed method is evaluated and compared with regularised estimation and traditional rotation methods via simulation studies. It is further illustrated by an application to big-five personality assessment.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/11/2020

Vintage Factor Analysis with Varimax Performs Statistical Inference

Psychologists developed Multiple Factor Analysis to decompose multivaria...
research
06/09/2021

On the Use of Minimum Penalties in Statistical Learning

Modern multivariate machine learning and statistical methodologies estim...
research
03/03/2022

A Correlation Thresholding Algorithm for Learning Factor Analysis Models

Factor analysis is a widely used method for modeling a set of observed v...
research
08/04/2019

Method of Contraction-Expansion (MOCE) for Simultaneous Inference in Linear Models

Simultaneous inference after model selection is of critical importance t...
research
12/01/2019

Algebraic Analysis of Rotation Data

We develop algebraic tools for statistical inference from samples of rot...
research
03/08/2016

On the inconsistency of ℓ_1-penalised sparse precision matrix estimation

Various ℓ_1-penalised estimation methods such as graphical lasso and CLI...

Please sign up or login with your details

Forgot password? Click here to reset