DeepAI AI Chat
Log In Sign Up

Driven to Distraction: Self-Supervised Distractor Learning for Robust Monocular Visual Odometry in Urban Environments

by   Dan Barnes, et al.
University of Oxford

We present a self-supervised approach to ignoring "distractors" in camera images for the purposes of robustly estimating vehicle motion in cluttered urban environments. We leverage offline multi-session mapping approaches to automatically generate a per-pixel ephemerality mask and depth map for each input image, which we use to train a deep convolutional network. At run-time we use the predicted ephemerality and depth as an input to a monocular visual odometry (VO) pipeline, using either sparse features or dense photometric matching. Our approach yields metric-scale VO using only a single camera and can recover the correct egomotion even when 90 dynamic, independently moving objects. We evaluate our robust VO methods on more than 400km of driving from the Oxford RobotCar Dataset and demonstrate reduced odometry drift and significantly improved egomotion estimation in the presence of large moving vehicles in urban traffic.


page 1

page 3

page 4

page 6

page 7


Dense Prediction Transformer for Scale Estimation in Monocular Visual Odometry

Monocular visual odometry consists of the estimation of the position of ...

D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometry

We propose D3VO as a novel framework for monocular visual odometry that ...

Self-Improving Visual Odometry

We propose a self-supervised learning framework that uses unlabeled mono...

Guided Depth Upsampling for Precise Mapping of Urban Environments

We present an improved model for MRF-based depth upsampling, guided by i...

Learning by Inertia: Self-supervised Monocular Visual Odometry for Road Vehicles

In this paper, we present iDVO (inertia-embedded deep visual odometry), ...

Real-Time Dense Mapping for Self-driving Vehicles using Fisheye Cameras

We present a real-time dense geometric mapping algorithm for large-scale...

A Self-Supervised, Differentiable Kalman Filter for Uncertainty-Aware Visual-Inertial Odometry

Traditionally, visual-inertial-odometry (VIO) systems rely on filtering ...