DeepAI AI Chat
Log In Sign Up

A General Framework of Learning Multi-Vehicle Interaction Patterns from Videos

07/17/2019
by   Chengyuan Zhang, et al.
Carnegie Mellon University
9

Semantic learning and understanding of multi-vehicle interaction patterns in a cluttered driving environment are essential but challenging for autonomous vehicles to make proper decisions. This paper presents a general framework to gain insights into intricate multi-vehicle interaction patterns from bird's-eye view traffic videos. We adopt a Gaussian velocity field to describe the time-varying multi-vehicle interaction behaviors and then use deep autoencoders to learn associated latent representations for each temporal frame. Then, we utilize a hidden semi-Markov model with a hierarchical Dirichlet process as a prior to segment these sequential representations into granular components, also called traffic primitives, corresponding to interaction patterns. Experimental results demonstrate that our proposed framework can extract traffic primitives from videos, thus providing a semantic way to analyze multi-vehicle interaction patterns, even for cluttered driving scenarios that are far messier than human beings can cope with.

READ FULL TEXT

page 2

page 4

page 6

03/02/2020

Spatiotemporal Learning of Multivehicle Interaction Patterns in Lane-Change Scenarios

Interpretation of common-yet-challenging interaction scenarios can benef...
06/25/2019

Modeling Multi-Vehicle Interaction Scenarios Using Gaussian Random Field

Autonomous vehicles (AV) are expected to navigate in complex traffic sce...
09/15/2018

Multi-Vehicle Trajectories Generation for Vehicle-to-Vehicle Encounters

Generating multi-vehicle trajectories analogous to these in real world c...
02/15/2021

Scalable nonparametric Bayesian learning for heterogeneous and dynamic velocity fields

Analysis of heterogeneous patterns in complex spatio-temporal data finds...
11/09/2018

An Empirical Evaluation On Vibrotactile Feedback For Wristband System

With the rapid development of mobile computing, wearable wrist-worn is b...
05/22/2021

V2V Spatiotemporal Interactive Pattern Recognition and Risk Analysis in Lane Changes

In complex lane change (LC) scenarios, semantic interpretation and safet...