Longitudinal Variational Autoencoder

06/17/2020
by   Siddharth Ramchandran, et al.
9

Longitudinal datasets measured repeatedly over time from individual subjects, arise in many biomedical, psychological, social, and other studies. Such multivariate time-series are often high-dimensional and contain missing values. A common approach to analyse this kind of data is to learn a low-dimensional representation using variational autoencoders (VAEs). However, standard VAEs assume that the learned representations are i.i.d., and fail to capture the correlations between the data samples. We propose a novel deep generative model, Longitudinal VAE (L-VAE), that uses a multi-output additive Gaussian process (GP) prior to extend the VAE's capability to learn structured low-dimensional representations imposed by auxiliary covariate information, and also derive a new divergence upper bound for such GPs. Our approach can simultaneously accommodate both time-varying shared and random effects, produce structured low-dimensional representations, disentangle effects of individual covariates or their interactions, and achieve highly accurate predictive performance. We compare our model against previous methods on synthetic and clinical datasets, and demonstrate the state-of-the-art performance in data imputation, reconstruction, and long-term prediction tasks.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 6

page 8

page 10

page 12

research
03/02/2022

Learning Conditional Variational Autoencoders with Missing Covariates

Conditional variational autoencoders (CVAEs) are versatile deep generati...
research
04/20/2022

A Variational Autoencoder for Heterogeneous Temporal and Longitudinal Data

The variational autoencoder (VAE) is a popular deep latent variable mode...
research
12/18/2017

Nonparametric Inference for Auto-Encoding Variational Bayes

We would like to learn latent representations that are low-dimensional a...
research
09/25/2019

The Dynamical Gaussian Process Latent Variable Model in the Longitudinal Scenario

The Dynamical Gaussian Process Latent Variable Models provide an elegant...
research
10/20/2021

Encoding spatiotemporal priors with VAEs for small-area estimation

Gaussian processes (GPs), implemented through multivariate Gaussian dist...
research
04/03/2018

Training VAEs Under Structured Residuals

Variational auto-encoders (VAEs) are a popular and powerful deep generat...
research
04/26/2023

AIRIVA: A Deep Generative Model of Adaptive Immune Repertoires

Recent advances in immunomics have shown that T-cell receptor (TCR) sign...

Please sign up or login with your details

Forgot password? Click here to reset