AMICO: Amodal Instance Composition

10/11/2022
by   Peiye Zhuang, et al.
0

Image composition aims to blend multiple objects to form a harmonized image. Existing approaches often assume precisely segmented and intact objects. Such assumptions, however, are hard to satisfy in unconstrained scenarios. We present Amodal Instance Composition for compositing imperfect – potentially incomplete and/or coarsely segmented – objects onto a target image. We first develop object shape prediction and content completion modules to synthesize the amodal contents. We then propose a neural composition model to blend the objects seamlessly. Our primary technical novelty lies in using separate foreground/background representations and blending mask prediction to alleviate segmentation errors. Our results show state-of-the-art performance on public COCOA and KINS benchmarks and attain favorable visual results across diverse scenes. We demonstrate various image composition applications such as object insertion and de-occlusion.

READ FULL TEXT

page 1

page 3

page 5

page 7

page 10

page 18

page 19

page 20

research
09/17/2020

Adversarial Image Composition with Auxiliary Illumination

Dealing with the inconsistency between a foreground object and a backgro...
research
04/21/2021

Shadow Generation for Composite Image in Real-world Scenes

Image composition targets at inserting a foreground object on a backgrou...
research
01/01/2020

Generating Object Stamps

We present an algorithm to generate diverse foreground objects and compo...
research
10/25/2019

Deep Image Blending

Image composition is an important operation to create visual content. Am...
research
09/17/2019

re-OBJ: Jointly Learning the Foreground and Background for Object Instance Re-identification

Conventional approaches to object instance re-identification rely on mat...
research
03/17/2020

F, B, Alpha Matting

Cutting out an object and estimating its opacity mask, known as image ma...
research
11/22/2022

ONeRF: Unsupervised 3D Object Segmentation from Multiple Views

We present ONeRF, a method that automatically segments and reconstructs ...

Please sign up or login with your details

Forgot password? Click here to reset