Salient Image Matting

03/23/2021
by   Rahul Deora, et al.
0

In this paper, we propose an image matting framework called Salient Image Matting to estimate the per-pixel opacity value of the most salient foreground in an image. To deal with a large amount of semantic diversity in images, a trimap is conventionally required as it provides important guidance about object semantics to the matting process. However, creating a good trimap is often expensive and timeconsuming. The SIM framework simultaneously deals with the challenge of learning a wide range of semantics and salient object types in a fully automatic and an end to end manner. Specifically, our framework is able to produce accurate alpha mattes for a wide range of foreground objects and cases where the foreground class, such as human, appears in a very different context than the train data directly from an RGB input. This is done by employing a salient object detection model to produce a trimap of the most salient object in the image in order to guide the matting model about higher-level object semantics. Our framework leverages large amounts of coarse annotations coupled with a heuristic trimap generation scheme to train the trimap prediction network so it can produce trimaps for arbitrary foregrounds. Moreover, we introduce a multi-scale fusion architecture for the task of matting to better capture finer, low-level opacity semantics. With high-level guidance provided by the trimap network, our framework requires only a fraction of expensive matting data as compared to other automatic methods while being able to produce alpha mattes for a diverse range of inputs. We demonstrate our framework on a range of diverse images and experimental results show our framework compares favourably against state of art matting methods without the need for a trimap

READ FULL TEXT

page 1

page 2

page 3

page 4

page 6

page 7

page 8

07/26/2016

Salient Object Subitizing

We study the problem of Salient Object Subitizing, i.e. predicting the e...
04/30/2020

Bilateral Attention Network for RGB-D Salient Object Detection

Most existing RGB-D salient object detection (SOD) methods focus on the ...
11/29/2019

CAGNet: Content-Aware Guidance for Salient Object Detection

Beneficial from Fully Convolutional Neural Networks (FCNs), saliency det...
07/15/2021

Deep Automatic Natural Image Matting

Automatic image matting (AIM) refers to estimating the soft foreground f...
11/25/2020

Combining Semantic Guidance and Deep Reinforcement Learning For Generating Human Level Paintings

Generation of stroke-based non-photorealistic imagery, is an important p...
01/07/2021

Multi-scale Information Assembly for Image Matting

Image matting is a long-standing problem in computer graphics and vision...
10/30/2020

End-to-end Animal Image Matting

Extracting accurate foreground animals from natural animal images benefi...