Cyclist Trajectory Forecasts by Incorporation of Multi-View Video Information

by   Stefan Zernetsch, et al.

This article presents a novel approach to incorporate visual cues from video-data from a wide-angle stereo camera system mounted at an urban intersection into the forecast of cyclist trajectories. We extract features from image and optical flow (OF) sequences using 3D convolutional neural networks (3D-ConvNet) and combine them with features extracted from the cyclist's past trajectory to forecast future cyclist positions. By the use of additional information, we are able to improve positional accuracy by about 7.5 a method solely based on past trajectories. Furthermore, we compare the use of image sequences to the use of OF sequences as additional information, showing that OF alone leads to significant improvements in positional accuracy. By training and testing our methods using a real-world dataset recorded at a heavily frequented public intersection and evaluating the methods' runtimes, we demonstrate the applicability in real traffic scenarios. Our code and parts of our dataset are made publicly available.



There are no comments yet.


page 2

page 3


Scene Compliant Trajectory Forecast with Agent-Centric Spatio-Temporal Grids

Forecasting long-term human motion is a challenging task due to the non-...

Novel Video Prediction for Large-scale Scene using Optical Flow

Making predictions of future frames is a critical challenge in autonomou...

Sales Forecast in E-commerce using Convolutional Neural Network

Sales forecast is an essential task in E-commerce and has a crucial impa...

Pose and Semantic Map Based Probabilistic Forecast of Vulnerable Road Users' Trajectories

In this article, an approach for probabilistic trajectory forecasting of...

Cyclist Intention Detection: A Probabilistic Approach

This article presents a holistic approach for probabilistic cyclist inte...

Action Sequence Predictions of Vehicles in Urban Environments using Map and Social Context

This work studies the problem of predicting the sequence of future actio...

Vehicle Trajectory Prediction in Crowded Highway Scenarios Using Bird Eye View Representations and CNNs

This paper describes a novel approach to perform vehicle trajectory pred...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.