Adaptive Background Matting Using Background Matching

by   Jinlin Liu, et al.

Due to the difficulty of solving the matting problem, lots of methods use some kinds of assistance to acquire high quality alpha matte. Green screen matting methods rely on physical equipment. Trimap-based methods take manual interactions as external input. Background-based methods require a pre-captured, static background. The methods are not flexible and convenient enough to use widely. Trimap-free methods are flexible but not stable in complicated video applications. To be stable and flexible in real applications, we propose an adaptive background matting method. The user first captures their videos freely, moving the cameras. Then the user captures the background video afterwards, roughly covering the previous captured regions. We use dynamic background video instead of static background for accurate matting. The proposed method is convenient to use in any scenes as the static camera and background is no more the limitation. To achieve this goal, we use background matching network to find the best-matched background frame by frame from dynamic backgrounds. Then, robust semantic estimation network is used to estimate the coarse alpha matte. Finally, we crop and zoom the target region according to the coarse alpha matte, and estimate the final accurate alpha matte. In experiments, the proposed method is able to perform comparably against the state-of-the-art matting methods.


page 2

page 4

page 6

page 7

page 8


Deep 3D Mask Volume for View Synthesis of Dynamic Scenes

Image view synthesis has seen great success in reconstructing photoreali...

Saliency detection with moving camera via background model completion

To detect saliency in video is a fundamental step in many computer visio...

Video Segmentation via Diffusion Bases

Identifying moving objects in a video sequence, which is produced by a s...

Towards an Understanding of Our World by GANing Videos in the Wild

Existing generative video models work well only for videos with a static...

Robust Online Matrix Factorization for Dynamic Background Subtraction

We propose an effective online background subtraction method, which can ...

Deep Image Matting with Flexible Guidance Input

Image matting is an important computer vision problem. Many existing mat...

A Maximum A Posteriori Estimation Framework for Robust High Dynamic Range Video Synthesis

High dynamic range (HDR) image synthesis from multiple low dynamic range...

Please sign up or login with your details

Forgot password? Click here to reset