Flow-edge Guided Video Completion

09/03/2020
by   Chen Gao, et al.
9

We present a new flow-based video completion algorithm. Previous flow completion methods are often unable to retain the sharpness of motion boundaries. Our method first extracts and completes motion edges, and then uses them to guide piecewise-smooth flow completion with sharp edges. Existing methods propagate colors among local flow connections between adjacent frames. However, not all missing regions in a video can be reached in this way because the motion boundaries form impenetrable barriers. Our method alleviates this problem by introducing non-local flow connections to temporally distant frames, enabling propagating video content over motion boundaries. We validate our approach on the DAVIS dataset. Both visual and quantitative results show that our method compares favorably against the state-of-the-art algorithms.

READ FULL TEXT

page 1

page 3

page 8

page 9

page 11

page 12

page 13

page 14

research
05/08/2019

Deep Flow-Guided Video Inpainting

Video inpainting, which aims at filling in missing regions of a video, r...
research
07/21/2022

Error Compensation Framework for Flow-Guided Video Inpainting

The key to video inpainting is to use correlation information from as ma...
research
03/12/2019

Unsupervised motion saliency map estimation based on optical flow inpainting

The paper addresses the problem of motion saliency in videos, that is, i...
research
12/02/2018

Disentangling Propagation and Generation for Video Prediction

Learning to predict future video frames is a challenging task. Recent ap...
research
06/04/2020

Image Completion and Extrapolation with Contextual Cycle Consistency

Image Completion refers to the task of filling in the missing regions of...
research
11/01/2021

Joint Detection of Motion Boundaries and Occlusions

We propose MONet, a convolutional neural network that jointly detects mo...
research
03/12/2020

Deformation Flow Based Two-Stream Network for Lip Reading

Lip reading is the task of recognizing the speech content by analyzing m...

Please sign up or login with your details

Forgot password? Click here to reset