Deep Image Synthesis from Intuitive User Input: A Review and Perspectives

07/09/2021
by   Yuan Xue, et al.
5

In many applications of computer graphics, art and design, it is desirable for a user to provide intuitive non-image input, such as text, sketch, stroke, graph or layout, and have a computer system automatically generate photo-realistic images that adhere to the input content. While classic works that allow such automatic image content generation have followed a framework of image retrieval and composition, recent advances in deep generative models such as generative adversarial networks (GANs), variational autoencoders (VAEs), and flow-based methods have enabled more powerful and versatile image generation tasks. This paper reviews recent works for image synthesis given intuitive user input, covering advances in input versatility, image generation methodology, benchmark datasets, and evaluation metrics. This motivates new perspectives on input representation and interactivity, cross pollination between major image generation paradigms, and evaluation and comparison of generation methods.

READ FULL TEXT

page 6

page 10

page 11

page 13

page 14

research
08/10/2021

Interpreting Generative Adversarial Networks for Interactive Image Generation

Great progress has been made by the advances in Generative Adversarial N...
research
01/25/2021

Adversarial Text-to-Image Synthesis: A Review

With the advent of generative adversarial networks, synthesizing images ...
research
05/04/2017

Auto-painter: Cartoon Image Generation from Sketch by Using Conditional Generative Adversarial Networks

Recently, realistic image generation using deep neural networks has beco...
research
07/11/2017

A step towards procedural terrain generation with GANs

Procedural terrain generation for video games has been traditionally bee...
research
06/17/2019

Inspirational Adversarial Image Generation

The task of image generation started to receive some attention from arti...
research
10/15/2020

The power of pictures: using ML assisted image generation to engage the crowd in complex socioscientific problems

Human-computer image generation using Generative Adversarial Networks (G...
research
03/21/2022

Review of Disentanglement Approaches for Medical Applications – Towards Solving the Gordian Knot of Generative Models in Healthcare

Deep neural networks are commonly used for medical purposes such as imag...

Please sign up or login with your details

Forgot password? Click here to reset