Trajectron++: Multi-Agent Generative Trajectory Forecasting With Heterogeneous Data for Control

01/09/2020
by   Tim Salzmann, et al.
0

Reasoning about human motion through an environment is an important prerequisite to safe and socially-aware robotic navigation. As a result, multi-agent behavior prediction has become a core component of modern human-robot interactive systems, such as self-driving cars. While there exist a multitude of methods for trajectory forecasting, many of them have only been evaluated with one semantic class of agents and only use prior trajectory information, ignoring a plethora of information available online to autonomous systems from common sensors. Towards this end, we present Trajectron++, a modular, graph-structured recurrent model that forecasts the trajectories of a general number of agents with distinct semantic classes while incorporating heterogeneous data (e.g. semantic maps and camera images). Our model is designed to be tightly integrated with robotic planning and control frameworks; it is capable of producing predictions that are conditioned on ego-agent motion plans. We demonstrate the performance of our model on several challenging real-world trajectory forecasting datasets, outperforming a wide array of state-of-the-art deterministic and generative methods.

READ FULL TEXT

page 1

page 2

page 4

page 5

page 6

page 7

page 10

page 12

research
04/26/2021

Heterogeneous-Agent Trajectory Forecasting Incorporating Class Uncertainty

Reasoning about the future behavior of other agents is critical to safe ...
research
09/16/2020

MATS: An Interpretable Trajectory Forecasting Representation for Planning and Control

Reasoning about human motion is a core component of modern human-robot i...
research
03/08/2022

Motron: Multimodal Probabilistic Human Motion Forecasting

Autonomous systems and humans are increasingly sharing the same space. R...
research
09/12/2020

Risk-Sensitive Sequential Action Control with Multi-Modal Human Trajectory Forecasting for Safe Crowd-Robot Interaction

This paper presents a novel online framework for safe crowd-robot intera...
research
09/16/2021

Raising context awareness in motion forecasting

Learning-based trajectory prediction models have encountered great succe...
research
10/14/2018

Modeling Multimodal Dynamic Spatiotemporal Graphs

Spatiotemporal graphs (STGs) are a powerful tool for modeling multi-agen...
research
11/02/2022

Heterogeneous Trajectory Forecasting via Risk and Scene Graph Learning

Heterogeneous trajectory forecasting is critical for intelligent transpo...

Please sign up or login with your details

Forgot password? Click here to reset