Time-series Imputation of Temporally-occluded Multiagent Trajectories

06/08/2021
by   Shayegan Omidshafiei, et al.
16

In multiagent environments, several decision-making individuals interact while adhering to the dynamics constraints imposed by the environment. These interactions, combined with the potential stochasticity of the agents' decision-making processes, make such systems complex and interesting to study from a dynamical perspective. Significant research has been conducted on learning models for forward-direction estimation of agent behaviors, for example, pedestrian predictions used for collision-avoidance in self-driving cars. However, in many settings, only sporadic observations of agents may be available in a given trajectory sequence. For instance, in football, subsets of players may come in and out of view of broadcast video footage, while unobserved players continue to interact off-screen. In this paper, we study the problem of multiagent time-series imputation, where available past and future observations of subsets of agents are used to estimate missing observations for other agents. Our approach, called the Graph Imputer, uses forward- and backward-information in combination with graph networks and variational autoencoders to enable learning of a distribution of imputed trajectories. We evaluate our approach on a dataset of football matches, using a projective camera module to train and evaluate our model for the off-screen player state estimation setting. We illustrate that our method outperforms several state-of-the-art approaches, including those hand-crafted for football.

READ FULL TEXT

page 4

page 8

page 13

page 16

page 17

page 18

page 19

03/06/2020

Diverse and Admissible Trajectory Forecasting through Multimodal Context Understanding

Multi-agent trajectory forecasting in autonomous driving requires an age...
10/14/2021

View Vertically: A Hierarchical Network for Trajectory Prediction via Fourier Spectrums

Learning to understand and predict future motions or behaviors for agent...
08/19/2022

Diffusion-based Time Series Imputation and Forecasting with Structured State Space Models

The imputation of missing values represents a significant obstacle for m...
02/05/2020

Learning Probabilistic Intersection Traffic Models for Trajectory Prediction

Autonomous agents must be able to safely interact with other vehicles to...
10/25/2021

Time series signal recovery methods: comparative study

Signal data often contains missing values. Effective replacement (imputa...
06/14/2016

Experimental and causal view on information integration in autonomous agents

The amount of digitally available but heterogeneous information about th...