DeepAI AI Chat
Log In Sign Up

Instance Segmentation based Semantic Matting for Compositing Applications

04/10/2019
by   Guanqing Hu, et al.
McGill University
48

Image compositing is a key step in film making and image editing that aims to segment a foreground object and combine it with a new background. Automatic image compositing can be done easily in a studio using chroma-keying when the background is pure blue or green. However, image compositing in natural scenes with complex backgrounds remains a tedious task, requiring experienced artists to hand-segment. In order to achieve automatic compositing in natural scenes, we propose a fully automated method that integrates instance segmentation and image matting processes to generate high-quality semantic mattes that can be used for image editing task. Our approach can be seen both as a refinement of existing instance segmentation algorithms and as a fully automated semantic image matting method. It extends automatic image compositing techniques such as chroma-keying to scenes with complex natural backgrounds without the need for any kind of user interaction. The output of our approach can be considered as both refined instance segmentations and alpha mattes with semantic meanings. We provide experimental results which show improved performance results as compared to existing approaches.

READ FULL TEXT

page 1

page 5

page 6

page 7

page 8

03/07/2020

AlphaNet: An Attention Guided Deep Network for Automatic Image Matting

In this paper, we propose an end to end solution for image matting i.e h...
03/25/2023

UnScene3D: Unsupervised 3D Instance Segmentation for Indoor Scenes

3D instance segmentation is fundamental to geometric understanding of th...
11/21/2016

Gland Instance Segmentation Using Deep Multichannel Neural Networks

Objective: A new image instance segmentation method is proposed to segme...
06/21/2023

Fast Segment Anything

The recently proposed segment anything model (SAM) has made a significan...
08/19/2022

Background Invariance Testing According to Semantic Proximity

In many applications, machine learned (ML) models are required to hold s...
10/18/2020

Localized Interactive Instance Segmentation

In current interactive instance segmentation works, the user is granted ...
12/29/2019

The Semantic Mutex Watershed for Efficient Bottom-Up Semantic Instance Segmentation

Semantic instance segmentation is the task of simultaneously partitionin...

Code Repositories

Segmentation_based_Semantic_Matting

None


view repo

Segmentation_based_Semantic_Matting

None


view repo

Instance-Segmentation-based-Semantic-Matting-for-Compositing-Applications

Publication and Poster


view repo

Image-Segmentation-With-Trimap

A image segmentation tool using trimap


view repo