Analyzing Bias in Diffusion-based Face Generation Models

05/10/2023
by   Malsha V. Perera, et al.
0

Diffusion models are becoming increasingly popular in synthetic data generation and image editing applications. However, these models can amplify existing biases and propagate them to downstream applications. Therefore, it is crucial to understand the sources of bias in their outputs. In this paper, we investigate the presence of bias in diffusion-based face generation models with respect to attributes such as gender, race, and age. Moreover, we examine how dataset size affects the attribute composition and perceptual quality of both diffusion and Generative Adversarial Network (GAN) based face generation models across various attribute classes. Our findings suggest that diffusion models tend to worsen distribution bias in the training data for various attributes, which is heavily influenced by the size of the dataset. Conversely, GAN models trained on balanced datasets with a larger number of samples show less bias across different attributes.

READ FULL TEXT

page 3

page 4

page 7

research
08/14/2019

FairFace: Face Attribute Dataset for Balanced Race, Gender, and Age

Existing public face datasets are strongly biased toward Caucasian faces...
research
10/31/2018

Generating Photo-Realistic Training Data to Improve Face Recognition Accuracy

In this paper we investigate the feasibility of using synthetic data to ...
research
09/20/2023

Face Aging via Diffusion-based Editing

In this paper, we address the problem of face aging: generating past or ...
research
08/07/2023

Balanced Face Dataset: Guiding StyleGAN to Generate Labeled Synthetic Face Image Dataset for Underrepresented Group

For a machine learning model to generalize effectively to unseen data wi...
research
04/06/2023

Data AUDIT: Identifying Attribute Utility- and Detectability-Induced Bias in Task Models

To safely deploy deep learning-based computer vision models for computer...
research
04/06/2023

Face Animation with an Attribute-Guided Diffusion Model

Face animation has achieved much progress in computer vision. However, p...
research
04/25/2022

StyleGAN-Human: A Data-Centric Odyssey of Human Generation

Unconditional human image generation is an important task in vision and ...

Please sign up or login with your details

Forgot password? Click here to reset