SketchFFusion: Sketch-guided image editing with diffusion model

04/06/2023
by   Weihang Mao, et al.
0

Sketch-guided image editing aims to achieve local fine-tuning of the image based on the sketch information provided by the user, while maintaining the original status of the unedited areas. Due to the high cost of acquiring human sketches, previous works mostly relied on edge maps as a substitute for sketches, but sketches possess more rich structural information. In this paper, we propose a sketch generation scheme that can preserve the main contours of an image and closely adhere to the actual sketch style drawn by the user. Simultaneously, current image editing methods often face challenges such as image distortion, training cost, and loss of fine details in the sketch. To address these limitations, We propose a conditional diffusion model (SketchFFusion) based on the sketch structure vector. We evaluate the generative performance of our model and demonstrate that it outperforms existing methods.

READ FULL TEXT

page 2

page 3

page 4

research
01/09/2020

Deep Plastic Surgery: Robust and Controllable Image Editing with Human-Drawn Sketches

Sketch-based image editing aims to synthesize and modify photos based on...
research
05/30/2023

DiffSketching: Sketch Control Image Synthesis with Diffusion Models

Creative sketch is a universal way of visual expression, but translating...
research
03/01/2023

Sketch2Cloth: Sketch-based 3D Garment Generation with Unsigned Distance Fields

3D model reconstruction from a single image has achieved great progress ...
research
11/30/2021

SketchEdit: Mask-Free Local Image Manipulation with Partial Sketches

Sketch-based image manipulation is an interactive image editing task to ...
research
11/12/2020

Deep Sketch-Based Modeling: Tips and Tricks

Deep image-based modeling received lots of attention in recent years, ye...
research
11/12/2012

Sketch Recognition using Domain Classification

Conceptualizing away the sketch processing details in a user interface w...
research
06/26/2014

DASS: Detail Aware Sketch-Based Surface Modeling

We present a sketch-based modeling system suitable for detail editing, b...

Please sign up or login with your details

Forgot password? Click here to reset