Evaluation Metrics for Conditional Image Generation

04/26/2020
by   Yaniv Benny, et al.
6

We present two new metrics for evaluating generative models in the class-conditional image generation setting. These metrics are obtained by generalizing the two most popular unconditional metrics: the Inception Score (IS) and the Fréchet Inception Distance (FID). A theoretical analysis shows the motivation behind each proposed metric and links the novel metrics to their unconditional counterparts. The link takes the form of a product in the case of IS or an upper bound in the FID case. We provide an extensive empirical evaluation, comparing the metrics to their unconditional variants and to other metrics, and utilize them to analyze existing generative models, thus providing additional insights about their performance, from unlearned classes to mode collapse.

READ FULL TEXT

page 7

page 10

page 11

page 12

page 13

research
03/21/2021

Conditional Frechet Inception Distance

We consider distance functions between conditional distributions functio...
research
02/03/2020

Improving the Evaluation of Generative Models with Fuzzy Logic

Objective and interpretable metrics to evaluate current artificial intel...
research
10/22/2019

Establishing an Evaluation Metric to Quantify Climate Change Image Realism

With success on controlled tasks, generative models are being increasing...
research
06/22/2022

A Study on the Evaluation of Generative Models

Implicit generative models, which do not return likelihood values, such ...
research
05/08/2023

Learning to Evaluate the Artness of AI-generated Images

Assessing the artness of AI-generated images continues to be a challenge...
research
01/21/2018

Decoupled Learning for Conditional Adversarial Networks

Incorporating encoding-decoding nets with adversarial nets has been wide...
research
02/23/2020

Reliable Fidelity and Diversity Metrics for Generative Models

Devising indicative evaluation metrics for the image generation task rem...

Please sign up or login with your details

Forgot password? Click here to reset