Peeking into the Future: Predicting Future Person Activities and Locations in Videos

02/11/2019
by   Junwei Liang, et al.
9

Deciphering human behaviors to predict their future paths/trajectories and what they would do from videos is important in many applications. Motivated by this idea, this paper studies predicting a pedestrian's future path jointly with future activities. We propose an end-to-end, multi-task learning system utilizing rich visual features about the human behavioral information and interaction with their surroundings. To facilitate the training, the network is learned with two auxiliary tasks of predicting future activities and the location in which the activity will happen. Experimental results demonstrate our state-of-the-art performance over two public benchmarks on future trajectory prediction. Moreover, our method is able to produce meaningful future activity prediction in addition to the path. The result provides the first empirical evidence that a joint modeling of paths and activities benefits future path prediction.

READ FULL TEXT

page 1

page 3

page 4

page 7

page 8

page 13

research
07/10/2020

VRUNet: Multi-Task Learning Model for Intent Prediction of Vulnerable Road Users

Advanced perception and path planning are at the core for any self-drivi...
research
12/13/2019

The Garden of Forking Paths: Towards Multi-Future Trajectory Prediction

This paper studies the problem of predicting the distribution over multi...
research
04/30/2020

Pedestrian Path, Pose and Intention Prediction through Gaussian Process Dynamical Models and Pedestrian Activity Recognition

According to several reports published by worldwide organisations, thous...
research
03/03/2017

Learning Robot Activities from First-Person Human Videos Using Convolutional Future Regression

We design a new approach that allows robot learning of new activities fr...
research
05/09/2019

Learning Representations for Predicting Future Activities

Foreseeing the future is one of the key factors of intelligence. It invo...
research
08/02/2019

Captioning Near-Future Activity Sequences

Most of the existing works on human activity analysis focus on recogniti...
research
08/13/2018

Time Perception Machine: Temporal Point Processes for the When, Where and What of Activity Prediction

Numerous powerful point process models have been developed to understand...

Please sign up or login with your details

Forgot password? Click here to reset