Deep Tracking on the Move: Learning to Track the World from a Moving Vehicle using Recurrent Neural Networks

09/29/2016
by   Julie Dequaire, et al.
0

This paper presents an end-to-end approach for tracking static and dynamic objects for an autonomous vehicle driving through crowded urban environments. Unlike traditional approaches to tracking, this method is learned end-to-end, and is able to directly predict a full unoccluded occupancy grid map from raw laser input data. Inspired by the recently presented DeepTracking approach [Ondruska, 2016], we employ a recurrent neural network (RNN) to capture the temporal evolution of the state of the environment, and propose to use Spatial Transformer modules to exploit estimates of the egomotion of the vehicle. Our results demonstrate the ability to track a range of objects, including cars, buses, pedestrians, and cyclists through occlusion, from both moving and stationary platforms, using a single learned model. Experimental results demonstrate that the model can also predict the future states of objects from current inputs, with greater accuracy than previous work.

READ FULL TEXT

page 1

page 5

page 7

research
11/17/2020

Dynamic Occupancy Grid Mapping with Recurrent Neural Networks

Modeling and understanding the environment is an essential task for auto...
research
04/18/2016

End-to-End Tracking and Semantic Segmentation Using Recurrent Neural Networks

In this work we present a novel end-to-end framework for tracking and cl...
research
03/29/2019

Deep, spatially coherent Occupancy Maps based on Radar Measurements

One essential step to realize modern driver assistance technology is the...
research
03/16/2018

Real-time Detection, Tracking, and Classification of Moving and Stationary Objects using Multiple Fisheye Images

The ability to detect pedestrians and other moving objects is crucial fo...
research
02/09/2022

A Multi-Task Recurrent Neural Network for End-to-End Dynamic Occupancy Grid Mapping

A common approach for modeling the environment of an autonomous vehicle ...
research
02/02/2016

Deep Tracking: Seeing Beyond Seeing Using Recurrent Neural Networks

This paper presents to the best of our knowledge the first end-to-end ob...
research
09/11/2018

Long-Term Occupancy Grid Prediction Using Recurrent Neural Networks

We tackle the long-term prediction of scene evolution in a complex downt...

Please sign up or login with your details

Forgot password? Click here to reset