Video De-fencing

10/08/2012
by   Yadong Mu, et al.
0

This paper describes and provides an initial solution to a novel video editing task, i.e., video de-fencing. It targets automatic restoration of the video clips that are corrupted by fence-like occlusions during capture. Our key observation lies in the visual parallax between fences and background scenes, which is caused by the fact that the former are typically closer to the camera. Unlike in traditional image inpainting, fence-occluded pixels in the videos tend to appear later in the temporal dimension and are therefore recoverable via optimized pixel selection from relevant frames. To eventually produce fence-free videos, major challenges include cross-frame sub-pixel image alignment under diverse scene depth, and "correct" pixel selection that is robust to dominating fence pixels. Several novel tools are developed in this paper, including soft fence detection, weighted truncated optical flow method and robust temporal median filter. The proposed algorithm is validated on several real-world video clips with fences.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 7

page 9

page 10

page 11

research
05/08/2019

Frame-Recurrent Video Inpainting by Robust Optical Flow Inference

In this paper, we present a new inpainting framework for recovering miss...
research
10/21/2016

Automatic Image De-fencing System

Tourists and Wild-life photographers are often hindered in capturing the...
research
03/04/2020

Occlusion Aware Unsupervised Learning of Optical Flow From Video

In this paper, we proposed an unsupervised learning method for estimatin...
research
02/11/2021

Frame Difference-Based Temporal Loss for Video Stylization

Neural style transfer models have been used to stylize an ordinary video...
research
05/08/2019

Deep Blind Video Decaptioning by Temporal Aggregation and Recurrence

Blind video decaptioning is a problem of automatically removing text ove...
research
09/23/2021

Layered Neural Atlases for Consistent Video Editing

We present a method that decomposes, or "unwraps", an input video into a...
research
03/18/2015

Video Inpainting of Complex Scenes

We propose an automatic video inpainting algorithm which relies on the o...

Please sign up or login with your details

Forgot password? Click here to reset