Pedestrian Action Anticipation using Contextual Feature Fusion in Stacked RNNs

05/13/2020
by   Amir Rasouli, et al.
13

One of the major challenges for autonomous vehicles in urban environments is to understand and predict other road users' actions, in particular, pedestrians at the point of crossing. The common approach to solving this problem is to use the motion history of the agents to predict their future trajectories. However, pedestrians exhibit highly variable actions most of which cannot be understood without visual observation of the pedestrians themselves and their surroundings. To this end, we propose a solution for the problem of pedestrian action anticipation at the point of crossing. Our approach uses a novel stacked RNN architecture in which information collected from various sources, both scene dynamics and visual features, is gradually fused into the network at different levels of processing. We show, via extensive empirical evaluations, that the proposed algorithm achieves a higher prediction accuracy compared to alternative recurrent network architectures. We conduct experiments to investigate the impact of the length of observation, time to event and types of features on the performance of the proposed method. Finally, we demonstrate how different data fusion strategies impact prediction accuracy.

READ FULL TEXT

page 1

page 2

page 4

page 7

page 9

research
11/16/2020

Multi-Modal Hybrid Architecture for Pedestrian Action Prediction

Pedestrian behavior prediction is one of the major challenges for intell...
research
12/03/2020

Graph-SIM: A Graph-based Spatiotemporal Interaction Modelling for Pedestrian Action Prediction

One of the most crucial yet challenging tasks for autonomous vehicles in...
research
07/16/2021

Is attention to bounding boxes all you need for pedestrian action prediction?

The human driver is no longer the only one concerned with the complexity...
research
10/14/2022

PedFormer: Pedestrian Behavior Prediction via Cross-Modal Attention Modulation and Gated Multitask Learning

Predicting pedestrian behavior is a crucial task for intelligent driving...
research
12/03/2020

Pedestrian Trajectory Prediction using Context-Augmented Transformer Networks

Forecasting the trajectory of pedestrians in shared urban traffic enviro...
research
06/01/2020

Off The Beaten Sidewalk: Pedestrian Prediction In Shared Spaces For Autonomous Vehicles

Pedestrians and drivers interact closely in a wide range of environments...

Please sign up or login with your details

Forgot password? Click here to reset