Scene Compliant Trajectory Forecast with Agent-Centric Spatio-Temporal Grids

09/16/2019
by   Daniela Ridel, et al.
23

Forecasting long-term human motion is a challenging task due to the non-linearity, multi-modality and inherent uncertainty in future trajectories. The underlying scene and past motion of agents can provide useful cues to predict their future motion. However, the heterogeneity of the two inputs poses a challenge for learning a joint representation of the scene and past trajectories. To address this challenge, we propose a model based on grid representations to forecast agent trajectories. We represent the past trajectories of agents using binary 2-D grids, and the underlying scene as a RGB birds-eye view (BEV) image, with an agent-centric frame of reference. We encode the scene and past trajectories using convolutional layers and generate trajectory forecasts using a Convolutional LSTM (ConvLSTM) decoder. Results on the publicly available Stanford Drone Dataset (SDD) show that our model outperforms prior approaches and outputs realistic future trajectories that comply with scene structure and past motion.

READ FULL TEXT

page 4

page 6

page 7

research
05/06/2020

Trajectory Prediction for Autonomous Driving based on Multi-Head Attention with Joint Agent-Map Representation

Predicting the trajectories of surrounding agents is an essential abilit...
research
06/30/2021

Cyclist Trajectory Forecasts by Incorporation of Multi-View Video Information

This article presents a novel approach to incorporate visual cues from v...
research
04/08/2021

Panoptic Segmentation Forecasting

Our goal is to forecast the near future given a set of recent observatio...
research
06/04/2021

Pose and Semantic Map Based Probabilistic Forecast of Vulnerable Road Users' Trajectories

In this article, an approach for probabilistic trajectory forecasting of...
research
01/03/2020

Trajectory Forecasts in Unknown Environments Conditioned on Grid-Based Plans

In this paper, we address the problem of forecasting agent trajectories ...
research
06/09/2020

Physically constrained short-term vehicle trajectory forecasting with naive semantic maps

Urban environments manifest a high level of complexity, and therefore it...
research
03/22/2016

Knowledge Transfer for Scene-specific Motion Prediction

When given a single frame of the video, humans can not only interpret th...

Please sign up or login with your details

Forgot password? Click here to reset