Where and Who? Automatic Semantic-Aware Person Composition

06/04/2017
by   Fuwen Tan, et al.
0

Image compositing is a method used to generate realistic yet fake imagery by inserting contents from one image to another. Previous work in compositing has focused on improving appearance compatibility of a user selected foreground segment and a background image (i.e. color and illumination consistency). In this work, we instead develop a fully automated compositing model that additionally learns to select and transform compatible foreground segments from a large collection given only an input image background. To simplify the task, we restrict our problem by focusing on human instance composition, because human segments exhibit strong correlations with their background and because of the availability of large annotated data. We develop a novel branching Convolutional Neural Network (CNN) that jointly predicts candidate person locations given a background image. We then use pre-trained deep feature representations to retrieve person instances from a large segment database. Experimental results show that our model can generate composite images that look visually convincing. We also develop a user interface to demonstrate the potential application of our method.

READ FULL TEXT

page 1

page 4

page 6

page 7

page 8

page 9

page 10

research
02/28/2017

Deep Image Harmonization

Compositing is one of the most common operations in photo editing. To ge...
research
05/29/2019

Emergence of Object Segmentation in Perturbed Generative Models

We introduce a novel framework to build a model that can learn how to se...
research
06/28/2021

Making Images Real Again: A Comprehensive Survey on Deep Image Composition

As a common image editing operation, image composition aims to cut the f...
research
12/02/2021

NeurSF: Neural Shading Field for Image Harmonization

Image harmonization aims at adjusting the appearance of the foreground t...
research
09/17/2020

Adversarial Image Composition with Auxiliary Illumination

Dealing with the inconsistency between a foreground object and a backgro...
research
12/07/2017

Disentangled Person Image Generation

Generating novel, yet realistic, images of persons is a challenging task...
research
07/06/2022

Spatial Transformation for Image Composition via Correspondence Learning

When using cut-and-paste to acquire a composite image, the geometry inco...

Please sign up or login with your details

Forgot password? Click here to reset