Making Images Real Again: A Comprehensive Survey on Deep Image Composition

06/28/2021
by   Li Niu, et al.
0

As a common image editing operation, image composition aims to cut the foreground from one image and paste it on another image, resulting in a composite image. However, there are many issues that could make the composite images unrealistic. These issues can be summarized as the inconsistency between foreground and background, which include appearance inconsistency (e.g., incompatible color and illumination) and geometry inconsistency (e.g., unreasonable size and location). Previous works on image composition target at one or more issues. Since each individual issue is a complicated problem, there are some research directions (e.g., image harmonization, object placement) which focus on only one issue. By putting all the efforts together, we can acquire realistic composite images. Sometimes, we expect the composite images to be not only realistic but also aesthetic, in which case aesthetic evaluation needs to be considered. In this survey, we summarize the datasets and methods for the above research directions. We also discuss the limitations and potential directions to facilitate the future research for image composition. Finally, as a double-edged sword, image composition may also have negative effect on our lives (e.g., fake news) and thus it is imperative to develop algorithms to fight against composite images. Datasets and codes for image composition are summarized at https://github.com/bcmi/Awesome-Image-Composition.

READ FULL TEXT

page 1

page 4

page 6

page 8

research
07/05/2021

OPA: Object Placement Assessment Dataset

Image composition aims to generate realistic composite image by insertin...
research
08/28/2019

Image Harmonization Datasets: HCOCO, HAdobe5k, HFlickr, and Hday2night

Image composition is an important operation in image processing, but the...
research
06/30/2023

RdSOBA: Rendered Shadow-Object Association Dataset

Image composition refers to inserting a foreground object into a backgro...
research
06/04/2017

Where and Who? Automatic Semantic-Aware Person Composition

Image compositing is a method used to generate realistic yet fake imager...
research
08/19/2023

ControlCom: Controllable Image Composition using Diffusion Model

Image composition targets at synthesizing a realistic composite image fr...
research
12/27/2022

Infusing Definiteness into Randomness: Rethinking Composition Styles for Deep Image Matting

We study the composition style in deep image matting, a notion that char...
research
08/05/2023

Deep Image Harmonization in Dual Color Spaces

Image harmonization is an essential step in image composition that adjus...

Please sign up or login with your details

Forgot password? Click here to reset