TITAN: Future Forecast using Action Priors

by   Srikanth Malla, et al.

We consider the problem of predicting the future trajectory of scene agents from egocentric views obtained from a moving platform. This problem is important in a variety of domains, particularly for autonomous systems making reactive or strategic decisions in navigation. In an attempt to address this problem, we introduce TITAN (Trajectory Inference using Targeted Action priors Network), a new model that incorporates prior positions, actions, and context to forecast future trajectory of agents and future ego-motion. In the absence of an appropriate dataset for this task, we created the TITAN dataset that consists of 700 labeled video-clips (with odometry) captured from a moving vehicle on highly interactive urban traffic scenes in Tokyo. Our dataset includes 50 labels including vehicle states and actions, pedestrian age groups, and targeted pedestrian action attributes that are organized hierarchically corresponding to atomic, simple/complex-contextual, transportive, and communicative actions. To evaluate our model, we conducted extensive experiments on the TITAN dataset, revealing significant performance improvement against baselines and state-of-the-art algorithms. We also report promising results from our Agent Importance Mechanism (AIM), a module which provides insight into assessment of perceived risk by calculating the relative influence of each agent on the future ego-trajectory. The dataset is available at https://usa.honda-ri.com/titan


page 3

page 4

page 7

page 8

page 12

page 14

page 16

page 17


Latent Variable Nested Set Transformers AutoBots

Humans have the innate ability to attend to the most relevant actors in ...

PePScenes: A Novel Dataset and Baseline for Pedestrian Action Prediction in 3D

Predicting the behavior of road users, particularly pedestrians, is vita...

Recognition and 3D Localization of Pedestrian Actions from Monocular Video

Understanding and predicting pedestrian behavior is an important and cha...

Tracing the Influence of Predecessors on Trajectory Prediction

In real-world traffic scenarios, agents such as pedestrians and car driv...

D2-TPred: Discontinuous Dependency for Trajectory Prediction under Traffic Lights

A profound understanding of inter-agent relationships and motion behavio...

SSP: Single Shot Future Trajectory Prediction

We propose a robust solution to future trajectory forecast, which can be...

Please sign up or login with your details

Forgot password? Click here to reset