DeepAI AI Chat
Log In Sign Up

Looking Ahead: Anticipating Pedestrians Crossing with Future Frames Prediction

by   Mohamed Chaabane, et al.

In this paper, we present an end-to-end future-prediction model that focuses on pedestrian safety. Specifically, our model uses previous video frames, recorded from the perspective of the vehicle, to predict if a pedestrian will cross in front of the vehicle. The long term goal of this work is to design a fully autonomous system that acts and reacts as a defensive human driver would — predicting future events and reacting to mitigate risk. We focus on pedestrian-vehicle interactions because of the high risk of harm to the pedestrian if their actions are miss-predicted. Our end-to-end model consists of two stages: the first stage is an encoder/decoder network that learns to predict future video frames. The second stage is a deep spatio-temporal network that utilizes the predicted frames of the first stage to predict the pedestrian's future action. Our system achieves state-of-the-art accuracy on pedestrian behavior prediction and future frames prediction on the Joint Attention for Autonomous Driving (JAAD) dataset.


page 2

page 4

page 9


"If you could see me through my eyes": Predicting Pedestrian Perception

Pedestrians are particularly vulnerable road users in urban traffic. Wit...

Is attention to bounding boxes all you need for pedestrian action prediction?

The human driver is no longer the only one concerned with the complexity...

Context-empowered Visual Attention Prediction in Pedestrian Scenarios

Effective and flexible allocation of visual attention is key for pedestr...

The Pedestrian Patterns Dataset

We present the pedestrian patterns dataset for autonomous driving. The d...

FuSSI-Net: Fusion of Spatio-temporal Skeletons for Intention Prediction Network

Pedestrian intention recognition is very important to develop robust and...

A Follow-the-Leader Strategy using Hierarchical Deep Neural Networks with Grouped Convolutions

The task of following-the-leader is implemented using a hierarchical Dee...

TITAN: Future Forecast using Action Priors

We consider the problem of predicting the future trajectory of scene age...