CTAB-GAN: Effective Table Data Synthesizing

02/16/2021
by   Zilong Zhao, et al.
0

While data sharing is crucial for knowledge development, privacy concerns and strict regulation (e.g., European General Data Protection Regulation (GDPR)) unfortunately limit its full effectiveness. Synthetic tabular data emerges as an alternative to enable data sharing while fulfilling regulatory and privacy constraints. The state-of-the-art tabular data synthesizers draw methodologies from generative Adversarial Networks (GAN) and address two main data types in the industry, i.e., continuous and categorical. In this paper, we develop CTAB-GAN, a novel conditional table GAN architecture that can effectively model diverse data types, including a mix of continuous and categorical variables. Moreover, we address data imbalance and long-tail issues, i.e., certain variables have drastic frequency differences across large values. To achieve those aims, we first introduce the information loss and classification loss to the conditional GAN. Secondly, we design a novel conditional vector, which efficiently encodes the mixed data type and skewed distribution of data variable. We extensively evaluate CTAB-GAN with the state of the art GANs that generate synthetic tables, in terms of data similarity and analysis utility. The results on five datasets show that the synthetic data of CTAB-GAN remarkably resembles the real data for all three types of variables and results into higher accuracy for five machine learning algorithms, by up to 17

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 2

page 10

page 11

08/13/2020

Synthesizing Property Casualty Ratemaking Datasets using Generative Adversarial Networks

Due to confidentiality issues, it can be difficult to access or share in...
06/09/2018

Data Synthesis based on Generative Adversarial Networks

Privacy is an important concern for our society where sharing data with ...
02/16/2021

A Bayesian Framework for Generation of Fully Synthetic Mixed Datasets

Much of the micro data used for epidemiological studies contain sensitiv...
01/03/2021

Copula Flows for Synthetic Data Generation

The ability to generate high-fidelity synthetic data is crucial when ava...
08/20/2020

Conditional Wasserstein GAN-based Oversampling of Tabular Data for Imbalanced Learning

Class imbalance is a common problem in supervised learning and impedes t...
06/24/2021

A Deep Learning Approach to Private Data Sharing of Medical Images Using Conditional GANs

Sharing data from clinical studies can facilitate innovative data-driven...
10/29/2021

Improving the quality of generative models through Smirnov transformation

Solving the convergence issues of Generative Adversarial Networks (GANs)...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.