DeepAI AI Chat
Log In Sign Up

User-Guided Deep Anime Line Art Colorization with Conditional Adversarial Networks

by   Yuanzheng Ci, et al.
Dalian University of Technology

Scribble colors based line art colorization is a challenging computer vision problem since neither greyscale values nor semantic information is presented in line arts, and the lack of authentic illustration-line art training pairs also increases difficulty of model generalization. Recently, several Generative Adversarial Nets (GANs) based methods have achieved great success. They can generate colorized illustrations conditioned on given line art and color hints. However, these methods fail to capture the authentic illustration distributions and are hence perceptually unsatisfying in the sense that they are often lack of accurate shading. To address these challenges, we propose a novel deep conditional adversarial architecture for scribble based anime line art colorization. Specifically, we integrate the conditional framework with WGAN-GP criteria as well as the perceptual loss to enable us to robustly train a deep network that makes the synthesized images more natural and real. We also introduce a local features network that is independent of synthetic data. With GANs conditioned on features from such network, we notably increase the generalization capability over "in the wild" line arts. Furthermore, we collect two datasets that provide high-quality colorful illustrations and authentic line arts for training and benchmarking. With the proposed model trained on our illustration dataset, we demonstrate that images synthesized by the presented approach are considerably more realistic and precise than alternative approaches.


page 5

page 7


Face Aging with Contextual Generative Adversarial Nets

Face aging, which renders aging faces for an input face, has attracted e...

Line Art Correlation Matching Network for Automatic Animation Colorization

Automatic animation line art colorization is a challenging computer visi...

Generating Image Sequence from Description with LSTM Conditional GAN

Generating images from word descriptions is a challenging task. Generati...

Conditional GANs for Multi-Illuminant Color Constancy: Revolution or Yet Another Approach?

Non-uniform and multi-illuminant color constancy are important tasks, th...

X-GANs: Image Reconstruction Made Easy for Extreme Cases

Image reconstruction including image restoration and denoising is a chal...

Fusing Global and Local Features for Generalized AI-Synthesized Image Detection

With the development of the Generative Adversarial Networks (GANs) and D...

NFTGAN: Non-Fungible Token Art Generation Using Generative Adversarial Networks

Digital arts have gained an unprecedented level of popularity with the e...