Missing Features Reconstruction and Its Impact on Classification Accuracy

11/09/2019
by   Magda Friedjungová, et al.
0

In real-world applications, we can encounter situations when a well-trained model has to be used to predict from a damaged dataset. The damage caused by missing or corrupted values can be either on the level of individual instances or on the level of entire features. Both situations have a negative impact on the usability of the model on such a dataset. This paper focuses on the scenario where entire features are missing which can be understood as a specific case of transfer learning. Our aim is to experimentally research the influence of various imputation methods on the performance of several classification models. The imputation impact is researched on a combination of traditional methods such as k-NN, linear regression, and MICE compared to modern imputation methods such as multi-layer perceptron (MLP) and gradient boosted trees (XGBT). For linear regression, MLP, and XGBT we also propose two approaches to using them for multiple features imputation. The experiments were performed on both real world and artificial datasets with continuous features where different numbers of features, varying from one feature to 50 missing. The results show that MICE and linear regression are generally good imputers regardless of the conditions. On the other hand, the performance of MLP and XGBT is strongly dataset dependent. Their performance is the best in some cases, but more often they perform worse than MICE or linear regression.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/21/2020

Missing Features Reconstruction Using a Wasserstein Generative Adversarial Imputation Network

Missing data is one of the most common preprocessing problems. In this p...
research
11/17/2015

Optimized Linear Imputation

Often in real-world datasets, especially in high dimensional data, some ...
research
04/07/2021

Prediction with Missing Data

Missing information is inevitable in real-world data sets. While imputat...
research
03/19/2023

Generative Adversarial Classification Network with Application to Network Traffic Classification

Large datasets in machine learning often contain missing data, which nec...
research
06/01/2021

What's a good imputation to predict with missing values?

How to learn a good predictor on data with missing values? Most efforts ...
research
01/11/2017

Multivariate Regression with Grossly Corrupted Observations: A Robust Approach and its Applications

This paper studies the problem of multivariate linear regression where a...
research
12/04/2022

Convergence Analysis of Data Augmentation Algorithms for Bayesian Robust Multivariate Linear Regression with Incomplete Data

Gaussian mixtures are commonly used for modeling heavy-tailed error dist...

Please sign up or login with your details

Forgot password? Click here to reset