DeepAI AI Chat
Log In Sign Up

Looking Ahead: Anticipating Pedestrians Crossing with Future Frames Prediction

10/20/2019
by   Mohamed Chaabane, et al.
1

In this paper, we present an end-to-end future-prediction model that focuses on pedestrian safety. Specifically, our model uses previous video frames, recorded from the perspective of the vehicle, to predict if a pedestrian will cross in front of the vehicle. The long term goal of this work is to design a fully autonomous system that acts and reacts as a defensive human driver would — predicting future events and reacting to mitigate risk. We focus on pedestrian-vehicle interactions because of the high risk of harm to the pedestrian if their actions are miss-predicted. Our end-to-end model consists of two stages: the first stage is an encoder/decoder network that learns to predict future video frames. The second stage is a deep spatio-temporal network that utilizes the predicted frames of the first stage to predict the pedestrian's future action. Our system achieves state-of-the-art accuracy on pedestrian behavior prediction and future frames prediction on the Joint Attention for Autonomous Driving (JAAD) dataset.

READ FULL TEXT

page 2

page 4

page 9

02/28/2022

"If you could see me through my eyes": Predicting Pedestrian Perception

Pedestrians are particularly vulnerable road users in urban traffic. Wit...
07/16/2021

Is attention to bounding boxes all you need for pedestrian action prediction?

The human driver is no longer the only one concerned with the complexity...
10/30/2022

Context-empowered Visual Attention Prediction in Pedestrian Scenarios

Effective and flexible allocation of visual attention is key for pedestr...
01/06/2020

The Pedestrian Patterns Dataset

We present the pedestrian patterns dataset for autonomous driving. The d...
05/15/2020

FuSSI-Net: Fusion of Spatio-temporal Skeletons for Intention Prediction Network

Pedestrian intention recognition is very important to develop robust and...
11/04/2020

A Follow-the-Leader Strategy using Hierarchical Deep Neural Networks with Grouped Convolutions

The task of following-the-leader is implemented using a hierarchical Dee...
03/31/2020

TITAN: Future Forecast using Action Priors

We consider the problem of predicting the future trajectory of scene age...