Variational Selective Autoencoder: Learning from Partially-Observed Heterogeneous Data

02/25/2021
by   Yu Gong, et al.
0

Learning from heterogeneous data poses challenges such as combining data from various sources and of different types. Meanwhile, heterogeneous data are often associated with missingness in real-world applications due to heterogeneity and noise of input sources. In this work, we propose the variational selective autoencoder (VSAE), a general framework to learn representations from partially-observed heterogeneous data. VSAE learns the latent dependencies in heterogeneous data by modeling the joint distribution of observed data, unobserved data, and the imputation mask which represents how the data are missing. It results in a unified model for various downstream tasks including data generation and imputation. Evaluation on both low-dimensional and high-dimensional heterogeneous datasets for these two tasks shows improvement over state-of-the-art models.

READ FULL TEXT
research
04/20/2022

A Variational Autoencoder for Heterogeneous Temporal and Longitudinal Data

The variational autoencoder (VAE) is a popular deep latent variable mode...
research
06/30/2021

DAEMA: Denoising Autoencoder with Mask Attention

Missing data is a recurrent and challenging problem, especially when usi...
research
06/21/2020

VAEM: a Deep Generative Model for Heterogeneous Mixed Type Data

Deep generative models often perform poorly in real-world applications d...
research
07/09/2019

Multivariate Time Series Imputation with Variational Autoencoders

Multivariate time series with missing values are common in many areas, f...
research
09/18/2023

Towards Better Modeling with Missing Data: A Contrastive Learning-based Visual Analytics Perspective

Missing data can pose a challenge for machine learning (ML) modeling. To...
research
08/27/2021

Multimodal Data Fusion in High-Dimensional Heterogeneous Datasets via Generative Models

The commonly used latent space embedding techniques, such as Principal C...
research
02/16/2022

Self-Organizing Maps for Exploration of Partially Observed Data and Imputation of Missing Values

The self-organizing map is an unsupervised neural network which is widel...

Please sign up or login with your details

Forgot password? Click here to reset