Region-Aware Portrait Retouching with Sparse Interactive Guidance

04/08/2023
by   Huimin Zeng, et al.
0

Portrait retouching aims to improve the aesthetic quality of input portrait photos and especially requires human-region priority. The deep learning-based methods largely elevate the retouching efficiency and provide promising retouched results. However, existing portrait retouching methods focus on automatic retouching, which treats all human-regions equally and ignores users' preferences for specific individuals, thus suffering from limited flexibility in interactive scenarios. In this work, we emphasize the importance of users' intents and explore the interactive portrait retouching task. Specifically, we propose a region-aware retouching framework with two branches: an automatic branch and an interactive branch. The automatic branch involves an encoding-decoding process, which searches region candidates and performs automatic region-aware retouching without user guidance. The interactive branch encodes sparse user guidance into a priority condition vector and modulates latent features with a region selection module to further emphasize the user-specified regions. Experimental results show that our interactive branch effectively captures users' intents and generalizes well to unseen scenes with sparse user guidance, while our automatic branch also outperforms the state-of-the-art retouching methods due to improved region-awareness.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 8

page 10

page 11

page 12

research
08/30/2021

Robust Interactive Semantic Segmentation of Pathology Images with Minimal User Input

From the simple measurement of tissue attributes in pathology workflow t...
research
08/07/2023

Feature Decoupling-Recycling Network for Fast Interactive Segmentation

Recent interactive segmentation methods iteratively take source image, u...
research
12/07/2018

Scale-aware multi-level guidance for interactive instance segmentation

In interactive instance segmentation, users give feedback to iteratively...
research
03/13/2023

Guiding the Guidance: A Comparative Analysis of User Guidance Signals for Interactive Segmentation of Volumetric Images

Interactive segmentation reduces the annotation time of medical images a...
research
07/17/2020

Grad-Cam Guided Progressive Feature CutMix for Classification

Image features from a small local region often give strong evidence in t...
research
11/11/2021

Clicking Matters:Towards Interactive Human Parsing

In this work, we focus on Interactive Human Parsing (IHP), which aims to...
research
12/15/2020

Improved Image Matting via Real-time User Clicks and Uncertainty Estimation

Image matting is a fundamental and challenging problem in computer visio...

Please sign up or login with your details

Forgot password? Click here to reset