BIGRoC: Boosting Image Generation via a Robust Classifier

08/08/2021
by   Roy Ganz, et al.
14

The interest of the machine learning community in image synthesis has grown significantly in recent years, with the introduction of a wide range of deep generative models and means for training them. Such machines' ultimate goal is to match the distributions of the given training images and the synthesized ones. In this work, we propose a general model-agnostic technique for improving the image quality and the distribution fidelity of generated images, obtained by any generative model. Our method, termed BIGRoC (boosting image generation via a robust classifier), is based on a post-processing procedure via the guidance of a given robust classifier and without a need for additional training of the generative model. Given a synthesized image, we propose to update it through projected gradient steps over the robust classifier, in an attempt to refine its recognition. We demonstrate this post-processing algorithm on various image synthesis methods and show a significant improvement of the generated images, both quantitatively and qualitatively.

READ FULL TEXT

page 1

page 4

page 6

page 9

page 12

page 13

page 14

page 15

research
05/08/2017

Generative Cooperative Net for Image Generation and Data Augmentation

How to build a good model for image generation given an abstract concept...
research
10/16/2022

DiffGAR: Model-Agnostic Restoration from Generative Artifacts Using Image-to-Image Diffusion Models

Recent generative models show impressive results in photo-realistic imag...
research
06/17/2019

Pose Guided Fashion Image Synthesis Using Deep Generative Model

Generating a photorealistic image with intended human pose is a promisin...
research
07/21/2022

Auto-regressive Image Synthesis with Integrated Quantization

Deep generative models have achieved conspicuous progress in realistic i...
research
06/17/2019

Inspirational Adversarial Image Generation

The task of image generation started to receive some attention from arti...
research
05/14/2018

Normal Similarity Network for Generative Modelling

Gaussian distributions are commonly used as a key building block in many...
research
11/29/2022

Taming a Generative Model

Generative models are becoming ever more powerful, being able to synthes...

Please sign up or login with your details

Forgot password? Click here to reset