Breaking the Spurious Causality of Conditional Generation via Fairness Intervention with Corrective Sampling

12/05/2022
by   Junhyun Nam, et al.
0

Trying to capture the sample-label relationship, conditional generative models often end up inheriting the spurious correlation in the training dataset, giving label-conditional distributions that are severely imbalanced in another latent attribute. To mitigate such undesirable correlations engraved into generative models, which we call spurious causality, we propose a general two-step strategy. (a) Fairness Intervention (FI): Emphasize the minority samples that are hard to be generated due to the spurious correlation in the training dataset. (b) Corrective Sampling (CS): Filter the generated samples explicitly to follow the desired label-conditional latent attribute distribution. We design the fairness intervention for various degrees of supervision on the spurious attribute, including unsupervised, weakly-supervised, and semi-supervised scenarios. Our experimental results show that the proposed FICS can successfully resolve the spurious correlation in generated samples on various datasets.

READ FULL TEXT

page 2

page 4

page 8

research
02/05/2019

TzK: Flow-Based Conditional Generative Model

We formulate a new class of conditional generative models based on proba...
research
07/16/2021

Measuring Fairness in Generative Models

Deep generative models have made much progress in improving training sta...
research
09/18/2021

PluGeN: Multi-Label Conditional Generation From Pre-Trained Models

Modern generative models achieve excellent quality in a variety of tasks...
research
12/09/2020

Improving the Fairness of Deep Generative Models without Retraining

Generative Adversarial Networks (GANs) have recently advanced face synth...
research
05/31/2022

Mitigating Dataset Bias by Using Per-sample Gradient

The performance of deep neural networks is strongly influenced by the tr...
research
06/30/2019

On the Sample Complexity of HGR Maximal Correlation Functions

The Hirschfeld-Gebelein-Rényi (HGR) maximal correlation and the correspo...
research
02/05/2020

Exploratory Machine Learning with Unknown Unknowns

In conventional supervised learning, a training dataset is given with gr...

Please sign up or login with your details

Forgot password? Click here to reset