Representation Learning of Pedestrian Trajectories Using Actor-Critic Sequence-to-Sequence Autoencoder

11/20/2018
by   Ka-Ho Chow, et al.
0

Representation learning of pedestrian trajectories transforms variable-length timestamp-coordinate tuples of a trajectory into a fixed-length vector representation that summarizes spatiotemporal characteristics. It is a crucial technique to connect feature-based data mining with trajectory data. Trajectory representation is a challenging problem, because both environmental constraints (e.g., wall partitions) and temporal user dynamics should be meticulously considered and accounted for. Furthermore, traditional sequence-to-sequence autoencoders using maximum log-likelihood often require dataset covering all the possible spatiotemporal characteristics to perform well. This is infeasible or impractical in reality. We propose TREP, a practical pedestrian trajectory representation learning algorithm which captures the environmental constraints and the pedestrian dynamics without the need of any training dataset. By formulating a sequence-to-sequence autoencoder with a spatial-aware objective function under the paradigm of actor-critic reinforcement learning, TREP intelligently encodes spatiotemporal characteristics of trajectories with the capability of handling diverse trajectory patterns. Extensive experiments on both synthetic and real datasets validate the high fidelity of TREP to represent trajectories.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/28/2018

Actor-Critic based Training Framework for Abstractive Summarization

We present a training framework for neural abstractive summarization bas...
research
10/02/2020

A Deeper Look at Discounting Mismatch in Actor-Critic Algorithms

We investigate the discounting mismatch in actor-critic algorithm implem...
research
12/27/2021

Wasserstein Flow Meets Replicator Dynamics: A Mean-Field Analysis of Representation Learning in Actor-Critic

Actor-critic (AC) algorithms, empowered by neural networks, have had sig...
research
12/12/2019

Semantic segmentation of trajectories with improved agent models for pedestrian behavior analysis

In this paper, we propose a method for semantic segmentation of pedestri...
research
10/14/2019

Actor Critic with Differentially Private Critic

Reinforcement learning algorithms are known to be sample inefficient, an...
research
02/24/2019

Machine Learning Aided Anonymization of Spatiotemporal Trajectory Datasets

The big data era requires a growing number of companies to publish their...
research
08/27/2021

Quantifying Intrinsic Value of Information of Trajectories

A trajectory, defined as a sequence of location measurements, contains v...

Please sign up or login with your details

Forgot password? Click here to reset