A Sharp Analysis of Covariate Adjusted Precision Matrix Estimation via Alternating Gradient Descent with Hard Thresholding

05/10/2021
by   Xiao Lv, et al.
0

In this paper, we present a sharp analysis for an alternating gradient descent algorithm which is used to solve the covariate adjusted precision matrix estimation problem in the high dimensional setting. Without the resampling assumption, we demonstrate that this algorithm not only enjoys a linear rate of convergence, but also attains the optimal statistical rate (i.e., minimax rate). Moreover, our analysis also characterizes the time-data tradeoffs in the covariate adjusted precision matrix estimation problem. Numerical experiments are provided to verify our theoretical results.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/02/2016

High Dimensional Multivariate Regression and Precision Matrix Estimation via Nonconvex Optimization

We propose a nonconvex estimator for joint multivariate regression and p...
research
03/06/2022

A Better Computational Framework for L_2E Regression

Building on previous research of Chi and Chi (2022), the current paper r...
research
02/18/2021

Don't Fix What ain't Broke: Near-optimal Local Convergence of Alternating Gradient Descent-Ascent for Minimax Optimization

Minimax optimization has recently gained a lot of attention as adversari...
research
11/02/2021

An Asymptotic Analysis of Minibatch-Based Momentum Methods for Linear Regression Models

Momentum methods have been shown to accelerate the convergence of the st...
research
02/28/2017

Speeding Up Latent Variable Gaussian Graphical Model Estimation via Nonconvex Optimizations

We study the estimation of the latent variable Gaussian graphical model ...
research
10/18/2021

Kernel-based estimation for partially functional linear model: Minimax rates and randomized sketches

This paper considers the partially functional linear model (PFLM) where ...
research
02/23/2023

Efficiently handling constraints with Metropolis-adjusted Langevin algorithm

In this study, we investigate the performance of the Metropolis-adjusted...

Please sign up or login with your details

Forgot password? Click here to reset