Deep Motion Boundary Detection

04/13/2018
by   Xiaoqing Yin, et al.
0

Motion boundary detection is a crucial yet challenging problem. Prior methods focus on analyzing the gradients and distributions of optical flow fields, or use hand-crafted features for motion boundary learning. In this paper, we propose the first dedicated end-to-end deep learning approach for motion boundary detection, which we term as MoBoNet. We introduce a refinement network structure which takes source input images, initial forward and backward optical flows as well as corresponding warping errors as inputs and produces high-resolution motion boundaries. Furthermore, we show that the obtained motion boundaries, through a fusion sub-network we design, can in turn guide the optical flows for removing the artifacts. The proposed MoBoNet is generic and works with any optical flows. Our motion boundary detection and the refined optical flow estimation achieve results superior to the state of the art.

READ FULL TEXT

page 2

page 5

page 12

page 14

research
02/28/2017

Boundary Flow: A Siamese Network that Predicts Boundary Motion without Training on Motion

This paper addresses a new problem of joint object boundary detection an...
research
01/23/2023

GyroFlow+: Gyroscope-Guided Unsupervised Deep Homography and Optical Flow Learning

Existing homography and optical flow methods are erroneous in challengin...
research
07/03/2017

End-to-End Learning of Video Super-Resolution with Motion Compensation

Learning approaches have shown great success in the task of super-resolv...
research
08/03/2022

Unsupervised Flow Refinement near Motion Boundaries

Unsupervised optical flow estimators based on deep learning have attract...
research
03/29/2023

AnyFlow: Arbitrary Scale Optical Flow with Implicit Neural Representation

To apply optical flow in practice, it is often necessary to resize the i...
research
08/10/2020

Deep Learning-based Human Detection for UAVs with Optical and Infrared Cameras: System and Experiments

In this paper, we present our deep learning-based human detection system...
research
03/31/2020

Probabilistic Pixel-Adaptive Refinement Networks

Encoder-decoder networks have found widespread use in various dense pred...

Please sign up or login with your details

Forgot password? Click here to reset