Automatic Foreground Extraction using Multi-Agent Consensus Equilibrium

08/24/2018
by   Xiran Wang, et al.
4

While foreground extraction is fundamental to virtual reality systems and has been studied for decades, majority of the professional softwares today still rely substantially on human interventions, e.g., providing trimaps or labeling key frames. This is not only time consuming, but is also sensitive to human error. In this paper, we present a fully automatic foreground extraction algorithm which does not require any trimap or scribble. Our solution is based on a newly developed concept called the Multi-Agent Consensus Equilibrium (MACE), a framework which allows us to integrate multiple sources of expertise to produce an overall superior result. The MACE framework consists of three agents: (1) A new dual layer closed-form matting agent to estimate the foreground mask using the color image and a background image; (2) A background probability estimator using color difference and object segmentation; (3) A total variation minimization agent to control the smoothness of the foreground masks. We show how these agents are constructed, and how their interactions lead to better performance. We evaluate the performance of the proposed algorithm by comparing to several state-of-the-art methods. On the real datasets we tested, our results show less error compared to the other methods.

READ FULL TEXT

page 2

page 3

page 5

page 7

page 8

page 9

page 10

page 13

research
06/29/2015

An automatic and efficient foreground object extraction scheme

This paper presents a method to differentiate the foreground objects fro...
research
02/07/2016

Screen Content Image Segmentation Using Sparse Decomposition and Total Variation Minimization

Sparse decomposition has been widely used for different applications, su...
research
02/10/2014

Foreground segmentation based on multi-resolution and matting

We propose a foreground segmentation algorithm that does foreground extr...
research
10/07/2021

Virtual Multi-Modality Self-Supervised Foreground Matting for Human-Object Interaction

Most existing human matting algorithms tried to separate pure human-only...
research
11/25/2018

Background Subtraction with Real-time Semantic Segmentation

Accurate and fast foreground object extraction is very important for obj...
research
09/15/2022

Robust Implementation of Foreground Extraction and Vessel Segmentation for X-ray Coronary Angiography Image Sequence

The extraction of contrast-filled vessels from X-ray coronary angiograph...
research
04/11/2016

Sparse Coding for Alpha Matting

Existing color sampling based alpha matting methods use the compositing ...

Please sign up or login with your details

Forgot password? Click here to reset