DeepAI AI Chat
Log In Sign Up

A General Framework of Learning Multi-Vehicle Interaction Patterns from Videos

by   Chengyuan Zhang, et al.
Carnegie Mellon University

Semantic learning and understanding of multi-vehicle interaction patterns in a cluttered driving environment are essential but challenging for autonomous vehicles to make proper decisions. This paper presents a general framework to gain insights into intricate multi-vehicle interaction patterns from bird's-eye view traffic videos. We adopt a Gaussian velocity field to describe the time-varying multi-vehicle interaction behaviors and then use deep autoencoders to learn associated latent representations for each temporal frame. Then, we utilize a hidden semi-Markov model with a hierarchical Dirichlet process as a prior to segment these sequential representations into granular components, also called traffic primitives, corresponding to interaction patterns. Experimental results demonstrate that our proposed framework can extract traffic primitives from videos, thus providing a semantic way to analyze multi-vehicle interaction patterns, even for cluttered driving scenarios that are far messier than human beings can cope with.


page 2

page 4

page 6


Spatiotemporal Learning of Multivehicle Interaction Patterns in Lane-Change Scenarios

Interpretation of common-yet-challenging interaction scenarios can benef...

Modeling Multi-Vehicle Interaction Scenarios Using Gaussian Random Field

Autonomous vehicles (AV) are expected to navigate in complex traffic sce...

Multi-Vehicle Trajectories Generation for Vehicle-to-Vehicle Encounters

Generating multi-vehicle trajectories analogous to these in real world c...

Scalable nonparametric Bayesian learning for heterogeneous and dynamic velocity fields

Analysis of heterogeneous patterns in complex spatio-temporal data finds...

An Empirical Evaluation On Vibrotactile Feedback For Wristband System

With the rapid development of mobile computing, wearable wrist-worn is b...

V2V Spatiotemporal Interactive Pattern Recognition and Risk Analysis in Lane Changes

In complex lane change (LC) scenarios, semantic interpretation and safet...