Minimax Quasi-Bayesian estimation in sparse canonical correlation analysis via a Rayleigh quotient function

10/16/2020
by   Qiuyun Zhu, et al.
0

Canonical correlation analysis (CCA) is a popular statistical technique for exploring the relationship between datasets. The estimation of sparse canonical correlation vectors has emerged in recent years as an important but challenging variation of the CCA problem, with widespread applications. Currently available rate-optimal estimators for sparse canonical correlation vectors are expensive to compute. We propose a quasi-Bayesian estimation procedure that achieves the minimax estimation rate, and yet is easy to compute by Markov Chain Monte Carlo (MCMC). The method builds on ([37]) and uses a re-scaled Rayleigh quotient function as a quasi-log-likelihood. However unlike these authors, we adopt a Bayesian framework that combines this quasi-log-likelihood with a spike-and-slab prior that serves to regularize the inference and promote sparsity. We investigated the empirical behavior of the proposed method on both continuous and truncated data, and we noted that it outperforms several state-of-the-art methods. As an application, we use the methodology to maximally correlate clinical variables and proteomic data for a better understanding of covid-19 disease.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/23/2020

Most Likely Optimal Subsampled Markov Chain Monte Carlo

Markov Chain Monte Carlo (MCMC) requires to evaluate the full data likel...
research
04/16/2014

Speeding Up MCMC by Efficient Data Subsampling

We propose Subsampling MCMC, a Markov Chain Monte Carlo (MCMC) framework...
research
10/08/2015

Empirical Analysis of Sampling Based Estimators for Evaluating RBMs

The Restricted Boltzmann Machines (RBM) can be used either as classifier...
research
01/18/2023

An MCMC Approach to Classical Estimation

This paper studies computationally and theoretically attractive estimato...
research
01/31/2020

Quasi-likelihood analysis for marked point processes and application to marked Hawkes processes

We develop a quasi-likelihood analysis procedure for a general class of ...
research
05/12/2016

Subspace Perspective on Canonical Correlation Analysis: Dimension Reduction and Minimax Rates

Canonical correlation analysis (CCA) is a fundamental statistical tool f...
research
06/17/2022

Optimal quasi-Bayesian reduced rank regression with incomplete response

The aim of reduced rank regression is to connect multiple response varia...

Please sign up or login with your details

Forgot password? Click here to reset