Auto-painter: Cartoon Image Generation from Sketch by Using Conditional Generative Adversarial Networks

05/04/2017
by   Yifan Liu, et al.
0

Recently, realistic image generation using deep neural networks has become a hot topic in machine learning and computer vision. Images can be generated at the pixel level by learning from a large collection of images. Learning to generate colorful cartoon images from black-and-white sketches is not only an interesting research problem, but also a potential application in digital entertainment. In this paper, we investigate the sketch-to-image synthesis problem by using conditional generative adversarial networks (cGAN). We propose the auto-painter model which can automatically generate compatible colors for a sketch. The new model is not only capable of painting hand-draw sketch with proper colors, but also allowing users to indicate preferred colors. Experimental results on two sketch datasets show that the auto-painter performs better that existing image-to-image methods.

READ FULL TEXT

page 8

page 10

research
03/30/2021

Identity-Aware CycleGAN for Face Photo-Sketch Synthesis and Recognition

Face photo-sketch synthesis and recognition has many applications in dig...
research
01/18/2020

Text-to-Image Generation with Attention Based Recurrent Neural Networks

Conditional image modeling based on textual descriptions is a relatively...
research
02/22/2017

Unsupervised Diverse Colorization via Generative Adversarial Networks

Colorization of grayscale images has been a hot topic in computer vision...
research
11/24/2017

Sketch-to-Image Generation Using Deep Contextual Completion

When the input to pix2pix translation is a badly drawn sketch, the outpu...
research
07/09/2021

Deep Image Synthesis from Intuitive User Input: A Review and Perspectives

In many applications of computer graphics, art and design, it is desirab...
research
11/16/2022

A Creative Industry Image Generation Dataset Based on Captions

Most image generation methods are difficult to precisely control the pro...
research
04/23/2021

Sketch-based Normal Map Generation with Geometric Sampling

Normal map is an important and efficient way to represent complex 3D mod...

Please sign up or login with your details

Forgot password? Click here to reset