A Note on Data Biases in Generative Models

12/04/2020
by   Patrick Esser, et al.
9

It is tempting to think that machines are less prone to unfairness and prejudice. However, machine learning approaches compute their outputs based on data. While biases can enter at any stage of the development pipeline, models are particularly receptive to mirror biases of the datasets they are trained on and therefore do not necessarily reflect truths about the world but, primarily, truths about the data. To raise awareness about the relationship between modern algorithms and the data that shape them, we use a conditional invertible neural network to disentangle the dataset-specific information from the information which is shared across different datasets. In this way, we can project the same image onto different datasets, thereby revealing their inherent biases. We use this methodology to (i) investigate the impact of dataset quality on the performance of generative models, (ii) show how societal biases of datasets are replicated by generative models, and (iii) present creative applications through unpaired transfer between diverse datasets such as photographs, oil portraits, and animes. Our code and an interactive demonstration are available at https://github.com/CompVis/net2net .

READ FULL TEXT

page 1

page 2

page 4

page 5

page 6

page 7

page 8

research
05/15/2023

Neural Boltzmann Machines

Conditional generative models are capable of using contextual informatio...
research
04/12/2020

A Non-Parametric Test to Detect Data-Copying in Generative Models

Detecting overfitting in generative models is an important challenge in ...
research
11/15/2022

Will Large-scale Generative Models Corrupt Future Datasets?

Recently proposed large-scale text-to-image generative models such as DA...
research
04/16/2020

ViBE: A Tool for Measuring and Mitigating Bias in Image Datasets

Machine learning models are known to perpetuate the biases present in th...
research
01/27/2023

Minimizing Trajectory Curvature of ODE-based Generative Models

Recent ODE/SDE-based generative models, such as diffusion models, rectif...
research
08/11/2022

Generative Models: An Interdisciplinary Perspective

By linking conceptual theories with observed data, generative models can...
research
02/20/2020

KaoKore: A Pre-modern Japanese Art Facial Expression Dataset

From classifying handwritten digits to generating strings of text, the d...

Please sign up or login with your details

Forgot password? Click here to reset