Pros and Cons of GAN Evaluation Measures: New Developments

03/17/2021
by   Ali Borji, et al.
0

This work is an update of a previous paper on the same topic published a few years ago. With the dramatic progress in generative modeling, a suite of new quantitative and qualitative techniques to evaluate models has emerged. Although some measures such as Inception Score, Fréchet Inception Distance, Precision-Recall, and Perceptual Path Length are relatively more popular, GAN evaluation is not a settled issue and there is still room for improvement. For example, in addition to quality and diversity of synthesized images, generative models should be evaluated in terms of bias and fairness. I describe new dimensions that are becoming important in assessing models, and discuss the connection between GAN evaluation and deepfakes.

READ FULL TEXT

page 5

page 6

page 13

page 15

page 16

page 18

page 19

page 20

research
02/27/2020

Measures to Evaluate Generative Adversarial Networks Based on Direct Analysis of Generated Images

The Generative Adversarial Network (GAN) is a state-of-the-art technique...
research
02/09/2018

Pros and Cons of GAN Evaluation Measures

Generative models, in particular generative adverserial networks (GANs),...
research
01/31/2022

On the Robustness of Quality Measures for GANs

This work evaluates the robustness of quality measures of generative mod...
research
05/31/2018

Assessing Generative Models via Precision and Recall

Recent advances in generative modeling have led to an increased interest...
research
06/06/2021

On Training Sample Memorization: Lessons from Benchmarking Generative Modeling with a Large-scale Competition

Many recent developments on generative models for natural images have re...
research
05/26/2019

Evaluating Generative Models Using Divergence Frontiers

Despite the tremendous progress in the estimation of generative models, ...
research
05/30/2023

Precision-Recall Divergence Optimization for Generative Modeling with GANs and Normalizing Flows

Achieving a balance between image quality (precision) and diversity (rec...

Please sign up or login with your details

Forgot password? Click here to reset