Scalable Regularised Joint Mixture Models

05/03/2022
by   Thomas Lartigue, et al.
0

In many applications, data can be heterogeneous in the sense of spanning latent groups with different underlying distributions. When predictive models are applied to such data the heterogeneity can affect both predictive performance and interpretability. Building on developments at the intersection of unsupervised learning and regularised regression, we propose an approach for heterogeneous data that allows joint learning of (i) explicit multivariate feature distributions, (ii) high-dimensional regression models and (iii) latent group labels, with both (i) and (ii) specific to latent groups and both elements informing (iii). The approach is demonstrably effective in high dimensions, combining data reduction for computational efficiency with a re-weighting scheme that retains key signals even when the number of features is large. We discuss in detail these aspects and their impact on modelling and computation, including EM convergence. The approach is modular and allows incorporation of data reductions and high-dimensional estimators that are suitable for specific applications. We show results from extensive simulations and real data experiments, including highly non-Gaussian data. Our results allow efficient, effective analysis of high-dimensional data in settings, such as biomedicine, where both interpretable prediction and explicit feature space models are needed but hidden heterogeneity may be a concern.

READ FULL TEXT
research
08/21/2019

Latent group structure and regularized regression

Regression modelling typically assumes homogeneity of the conditional di...
research
03/10/2023

Informative co-data learning for high-dimensional Horseshoe regression

High-dimensional data often arise from clinical genomics research to inf...
research
12/23/2022

Sufficient Dimension Reduction for Populations with Structured Heterogeneity

A key challenge in building effective regression models for large and di...
research
10/14/2020

Neural Mixture Distributional Regression

We present neural mixture distributional regression (NMDR), a holistic f...
research
02/22/2019

Model-based clustering in very high dimensions via adaptive projections

Mixture models are a standard approach to dealing with heterogeneous dat...
research
03/28/2019

Using Latent Class Analysis to Identify ARDS Sub-phenotypes for Enhanced Machine Learning Predictive Performance

In this work, we utilize Machine Learning for early recognition of patie...
research
10/24/2022

Occam learning

We discuss probabilistic neural network models for unsupervised learning...

Please sign up or login with your details

Forgot password? Click here to reset