Restricted maximum-likelihood method for learning latent variance components in gene expression data with known and unknown confounders

05/06/2020
by   Muhammad Ammar Malik, et al.
0

Linear mixed modelling is a popular approach for detecting and correcting spurious sample correlations due to hidden confounders in genome-wide gene expression data. In applications where some confounding factors are known, estimating simultaneously the contribution of known and latent variance components in linear mixed models is a challenge that has so far relied on numerical gradient-based optimizers to maximize the likelihood function. This is unsatisfactory because the resulting solution is poorly characterized and the efficiency of the method may be suboptimal. Here we prove analytically that maximum-likelihood latent variables can always be chosen orthogonal to the known confounding factors, in other words, that maximum-likelihood latent variables explain sample covariances not already explained by known factors. Based on this result we propose a restricted maximum-likelihood method which estimates the latent variables by maximizing the likelihood on the restricted subspace orthogonal to the known confounding factors, and show that this reduces to probabilistic PCA on that subspace. The method then estimates the variance-covariance parameters by maximizing the remaining terms in the likelihood function given the latent variables, using a newly derived analytic solution for this problem. Compared to gradient-based optimizers, our method attains equal or higher likelihood values, can be computed using standard matrix operations, results in latent factors that don't overlap with any known factors, and has a runtime reduced by several orders of magnitude. We anticipate that the restricted maximum-likelihood method will facilitate the application of linear mixed modelling strategies for learning latent variance components to much larger gene expression datasets than currently possible.

READ FULL TEXT
research
03/11/2018

Reduction of Restricted Maximum Likelihood for Random Coefficient Models

The restricted maximum likelihood (REML) estimator of the dispersion mat...
research
03/15/2012

Maximum likelihood fitting of acyclic directed mixed graphs to binary data

Acyclic directed mixed graphs, also known as semi-Markov models represen...
research
05/11/2018

Essential formulae for restricted maximum likelihood and its derivatives associated with the linear mixed models

The restricted maximum likelihood method enhances popularity of maximum ...
research
07/20/2022

Maximum Likelihood Imputation

Maximum likelihood (ML) estimation is widely used in statistics. The h-l...
research
10/16/2012

Latent Composite Likelihood Learning for the Structured Canonical Correlation Model

Latent variable models are used to estimate variables of interest quanti...
research
01/25/2022

Imputation Maximization Stochastic Approximation with Application to Generalized Linear Mixed Models

Generalized linear mixed models are useful in studying hierarchical data...
research
03/02/2023

Vine dependence graphs with latent variables as summaries for gene expression data

The advent of high-throughput sequencing technologies has lead to vast c...

Please sign up or login with your details

Forgot password? Click here to reset