Self-Supervised Flow Estimation using Geometric Regularization with Applications to Camera Image and Grid Map Sequences

04/17/2019
by   Sascha Wirges, et al.
0

We present a self-supervised approach to estimate flow in camera image and top-view grid map sequences using fully convolutional neural networks in the domain of automated driving. We extend existing approaches for self-supervised optical flow estimation by adding a regularizer expressing motion consistency assuming a static environment. However, as this assumption is violated for other moving traffic participants we also estimate a mask to scale this regularization. Adding a regularization towards motion consistency improves convergence and flow estimation accuracy. Furthermore, we scale the errors due to spatial flow inconsistency by a mask that we derive from the motion mask. This improves accuracy in regions where the flow drastically changes due to a better separation between static and dynamic environment. We apply our approach to optical flow estimation from camera image sequences, validate on odometry estimation and suggest a method to iteratively increase optical flow estimation accuracy using the generated motion masks. Finally, we provide quantitative and qualitative results based on the KITTI odometry and tracking benchmark for scene flow estimation based on grid map sequences. We show that we can improve accuracy and convergence when applying motion and spatial consistency regularization.

READ FULL TEXT
research
12/09/2019

Self-supervised Object Motion and Depth Estimation from Video

We present a self-supervised learning framework to estimate the individu...
research
05/30/2021

Unsupervised Joint Learning of Depth, Optical Flow, Ego-motion from Video

Estimating geometric elements such as depth, camera motion, and optical ...
research
09/04/2023

EMR-MSF: Self-Supervised Recurrent Monocular Scene Flow Exploiting Ego-Motion Rigidity

Self-supervised monocular scene flow estimation, aiming to understand bo...
research
05/09/2018

Layered Optical Flow Estimation Using a Deep Neural Network with a Soft Mask

Using a layered representation for motion estimation has the advantage o...
research
05/29/2017

Towards Visual Ego-motion Learning in Robots

Many model-based Visual Odometry (VO) algorithms have been proposed in t...
research
05/03/2022

RAFT-MSF: Self-Supervised Monocular Scene Flow using Recurrent Optimizer

Learning scene flow from a monocular camera still remains a challenging ...
research
11/04/2016

Regularized Pel-Recursive Motion Estimation Using Generalized Cross-Validation and Spatial Adaptation

The computation of 2-D optical flow by means of regularized pel-recursiv...

Please sign up or login with your details

Forgot password? Click here to reset