MCFlow: Monte Carlo Flow Models for Data Imputation

03/27/2020
by   Trevor W. Richardson, et al.
0

We consider the topic of data imputation, a foundational task in machine learning that addresses issues with missing data. To that end, we propose MCFlow, a deep framework for imputation that leverages normalizing flow generative models and Monte Carlo sampling. We address the causality dilemma that arises when training models with incomplete data by introducing an iterative learning scheme which alternately updates the density estimate and the values of the missing entries in the training data. We provide extensive empirical validation of the effectiveness of the proposed method on standard multivariate and image datasets, and benchmark its performance against state-of-the-art alternatives. We demonstrate that MCFlow is superior to competing methods in terms of the quality of the imputed data, as well as with regards to its ability to preserve the semantic structure of the data.

READ FULL TEXT
research
02/09/2022

Missing Data Imputation and Acquisition with Deep Hierarchical Models and Hamiltonian Monte Carlo

Variational Autoencoders (VAEs) have recently been highly successful at ...
research
06/09/2021

EMFlow: Data Imputation in Latent Space via EM and Deep Flow Models

High dimensional incomplete data can be found in a wide range of systems...
research
03/03/2021

A Hamiltonian Monte Carlo Model for Imputation and Augmentation of Healthcare Data

Missing values exist in nearly all clinical studies because data for a v...
research
05/13/2020

Multiple Imputation for Biomedical Data using Monte Carlo Dropout Autoencoders

Due to complex experimental settings, missing values are common in biome...
research
08/07/2023

Generative Forests

Tabular data represents one of the most prevalent form of data. When it ...
research
10/26/2021

MisConv: Convolutional Neural Networks for Missing Data

Processing of missing data by modern neural networks, such as CNNs, rema...
research
10/29/2021

Quality control, data cleaning, imputation

This chapter addresses important steps during the quality assurance and ...

Please sign up or login with your details

Forgot password? Click here to reset