Foresee: Attentive Future Projections of Chaotic Road Environments with Online Training

05/30/2018
by   Anil Sharma, et al.
0

In this paper, we train a recurrent neural network to learn dynamics of a chaotic road environment and to project the future of the environment on an image. Future projection can be used to anticipate an unseen environment for example, in autonomous driving. Road environment is highly dynamic and complex due to the interaction among traffic participants such as vehicles and pedestrians. Even in this complex environment, a human driver is efficacious to safely drive on chaotic roads irrespective of the number of traffic participants. The proliferation of deep learning research has shown the efficacy of neural networks in learning this human behavior. In the same direction, we investigate recurrent neural networks to understand the chaotic road environment which is shared by pedestrians, vehicles (cars, trucks, bicycles etc.), and sometimes animals as well. We propose Foresee, a unidirectional gated recurrent units (GRUs) network with attention to project future of the environment in the form of images. We have collected several videos on Delhi roads consisting of various traffic participants, background and infrastructure differences (like 3D pedestrian crossing) at various times on various days. We train Foresee in an unsupervised way and we use online training to project frames up to 0.5 seconds in advance. We show that our proposed model performs better than state of the art methods (prednet and Enc. Dec. LSTM) and finally, we show that our trained model generalizes to a public dataset for future projections.

READ FULL TEXT

page 1

page 5

page 6

page 7

page 8

research
02/28/2022

"If you could see me through my eyes": Predicting Pedestrian Perception

Pedestrians are particularly vulnerable road users in urban traffic. Wit...
research
11/16/2020

Multi-Modal Hybrid Architecture for Pedestrian Action Prediction

Pedestrian behavior prediction is one of the major challenges for intell...
research
03/28/2018

Predictions of short-term driving intention using recurrent neural network on sequential data

Predictions of driver's intentions and their behaviors using the road is...
research
02/07/2018

Joint Attention in Driver-Pedestrian Interaction: from Theory to Practice

Today, one of the major challenges that autonomous vehicles are facing i...
research
05/18/2022

Improving Pedestrian Priority via Grouping and Virtual Lanes

The shared space design is applied in urban streets to support barrier-f...
research
10/14/2020

Development of Open Informal Dataset Affecting Autonomous Driving

This document is a document that has written procedures and methods for ...
research
02/24/2021

Spatio-Temporal Look-Ahead Trajectory Prediction using Memory Neural Network

Prognostication of vehicle trajectories in unknown environments is intri...

Please sign up or login with your details

Forgot password? Click here to reset