Cali-Sketch: Stroke Calibration and Completion for High-Quality Face Image Generation from Poorly-Drawn Sketches

11/01/2019
by   Weihao Xia, et al.
4

Image generation task has received increasing attention because of its wide application in security and entertainment. Sketch-based face generation brings more fun and better quality of image generation due to supervised interaction. However, When a sketch poorly aligned with the true face is given as input, existing supervised image-to-image translation methods often cannot generate acceptable photo-realistic face images. To address this problem, in this paper we propose Cali-Sketch, a poorly-drawn-sketch to photo-realistic-image generation method. Cali-Sketch explicitly models stroke calibration and image generation using two constituent networks: a Stroke Calibration Network (SCN), which calibrates strokes of facial features and enriches facial details while preserving the original intent features; and an Image Synthesis Network (ISN), which translates the calibrated and enriched sketches to photo-realistic face images. In this way, we manage to decouple a difficult cross-domain translation problem into two easier steps. Extensive experiments verify that the face photos generated by Cali-Sketch are both photo-realistic and faithful to the input sketches, compared with state-of-the-art methods

READ FULL TEXT

page 1

page 4

page 5

page 6

page 8

research
10/27/2017

High-Quality Facial Photo-Sketch Synthesis Using Multi-Adversarial Networks

Synthesizing face sketches from real photos and its inverse are well stu...
research
11/24/2017

Sketch-to-Image Generation Using Deep Contextual Completion

When the input to pix2pix translation is a badly drawn sketch, the outpu...
research
12/06/2021

DoodleFormer: Creative Sketch Drawing with Transformers

Creative sketching or doodling is an expressive activity, where imaginat...
research
06/02/2017

r-BTN: Cross-domain Face Composite and Synthesis from Limited Facial Patches

We start by asking an interesting yet challenging question, "If an eyewi...
research
03/19/2022

ALAP-AE: As-Lite-as-Possible Auto-Encoder

We present a novel algorithm to reduce tensor compute required by a cond...
research
08/31/2020

DeepFacePencil: Creating Face Images from Freehand Sketches

In this paper, we explore the task of generating photo-realistic face im...
research
07/17/2022

Effect of Instance Normalization on Fine-Grained Control for Sketch-Based Face Image Generation

Sketching is an intuitive and effective way for content creation. While ...

Please sign up or login with your details

Forgot password? Click here to reset