DeepAI AI Chat
Log In Sign Up

"If you could see me through my eyes": Predicting Pedestrian Perception

by   Julian Petzold, et al.
Universität Lübeck

Pedestrians are particularly vulnerable road users in urban traffic. With the arrival of autonomous driving, novel technologies can be developed specifically to protect pedestrians. We propose a machine learning toolchain to train artificial neural networks as models of pedestrian behavior. In a preliminary study, we use synthetic data from simulations of a specific pedestrian crossing scenario to train a variational autoencoder and a long short-term memory network to predict a pedestrian's future visual perception. We can accurately predict a pedestrian's future perceptions within relevant time horizons. By iteratively feeding these predicted frames into these networks, they can be used as simulations of pedestrians as indicated by our results. Such trained networks can later be used to predict pedestrian behaviors even from the perspective of the autonomous car. Another future extension will be to re-train these networks with real-world video data.


page 3

page 4

page 5


Looking Ahead: Anticipating Pedestrians Crossing with Future Frames Prediction

In this paper, we present an end-to-end future-prediction model that foc...

Foresee: Attentive Future Projections of Chaotic Road Environments with Online Training

In this paper, we train a recurrent neural network to learn dynamics of ...

Predicting Pedestrian Crosswalk Behavior Using Convolutional Neural Networks

A common yet potentially dangerous task is the act of crossing the stree...

Intentions of Vulnerable Road Users - Detection and Forecasting by Means of Machine Learning

Avoiding collisions with vulnerable road users (VRUs) using sensor-based...

VRUNet: Multi-Task Learning Model for Intent Prediction of Vulnerable Road Users

Advanced perception and path planning are at the core for any self-drivi...

ADOPT: A system for Alerting Drivers to Occluded Pedestrian Traffic

Recent statistics reveal an alarming increase in accidents involving ped...

Pedestrian Stop and Go Forecasting with Hybrid Feature Fusion

Forecasting pedestrians' future motions is essential for autonomous driv...