Random Network Distillation as a Diversity Metric for Both Image and Text Generation

10/13/2020
by   Liam Fowl, et al.
2

Generative models are increasingly able to produce remarkably high quality images and text. The community has developed numerous evaluation metrics for comparing generative models. However, these metrics do not effectively quantify data diversity. We develop a new diversity metric that can readily be applied to data, both synthetic and natural, of any type. Our method employs random network distillation, a technique introduced in reinforcement learning. We validate and deploy this metric on both images and text. We further explore diversity in few-shot image generation, a setting which was previously difficult to evaluate.

READ FULL TEXT

page 5

page 6

page 7

page 8

page 14

page 16

research
06/17/2022

Rarity Score : A New Metric to Evaluate the Uncommonness of Synthesized Images

Evaluation metrics in image synthesis play a key role to measure perform...
research
04/08/2019

Jointly Measuring Diversity and Quality in Text Generation Models

Text generation is an important Natural Language Processing task with va...
research
04/21/2018

Eval all, trust a few, do wrong to none: Comparing sentence generation models

In this paper, we study recent neural generative models for text generat...
research
05/20/2022

Diversity vs. Recognizability: Human-like generalization in one-shot generative models

Robust generalization to new concepts has long remained a distinctive fe...
research
05/04/2020

Distributional Discrepancy: A Metric for Unconditional Text Generation

The goal of unconditional text generation is training a model with real ...
research
07/03/2020

On the Relation between Quality-Diversity Evaluation and Distribution-Fitting Goal in Text Generation

The goal of text generation models is to fit the underlying real probabi...
research
04/18/2022

Simultaneous Multiple-Prompt Guided Generation Using Differentiable Optimal Transport

Recent advances in deep learning, such as powerful generative models and...

Please sign up or login with your details

Forgot password? Click here to reset