DeepAI AI Chat
Log In Sign Up

Bayesian clustering using random effects models and predictive projections

by   Yinan Mao, et al.

Linear mixed models are widely used for analyzing hierarchically structured data involving missingness and unbalanced study designs. We consider a Bayesian clustering method that combines linear mixed models and predictive projections. For each observation, we consider a predictive replicate in which only a subset of the random effects is shared between the observation and its replicate, with the remainder being integrated out using the conditional prior. Predictive projections are then defined in which the number of distinct values taken by the shared random effects is finite, in order to obtain different clusters. Integrating out some of the random effects acts as a noise filter, allowing the clustering to be focused on only certain chosen features of the data. The method is inspired by methods for Bayesian model checking, in which simulated data replicates from a fitted model are used for model criticism by examining their similarity to the observed data in relevant ways. Here the predictive replicates are used to define similarity between observations in relevant ways for clustering. To illustrate the way our method reveals aspects of the data at different scales, we consider fitting temporal trends in longitudinal data using Fourier cosine bases with a random effect for each basis function, and different clusterings defined by shared random effects for replicates of low or high frequency terms. The method is demonstrated in a series of real examples.


page 16

page 29

page 35


LMLFM: Longitudinal Multi-Level Factorization Machine

We consider the problem of learning predictive models from longitudinal ...

Bayesian joint models for longitudinal and survival data

This paper takes a quick look at Bayesian joint models (BJM) for longitu...

High-dimensional clustering via Random Projections

In this work, we address the unsupervised classification issue by exploi...

Toward a diagnostic toolkit for linear models with Gaussian-process distributed random effects

Gaussian processes (GPs) are widely used as distributions of random effe...

Model Specification in Mixed-Effects Models: A Focus on Random Effects

Mixed-effect models are flexible tools for researchers in a myriad of me...

Mixed Effects Neural ODE: A Variational Approximation for Analyzing the Dynamics of Panel Data

Panel data involving longitudinal measurements of the same set of partic...

Masking schemes for universal marginalisers

We consider the effect of structure-agnostic and structure-dependent mas...