Learning and Predicting Multimodal Vehicle Action Distributions in a Unified Probabilistic Model Without Labels

12/14/2022
by   Charles Richter, et al.
0

We present a unified probabilistic model that learns a representative set of discrete vehicle actions and predicts the probability of each action given a particular scenario. Our model also enables us to estimate the distribution over continuous trajectories conditioned on a scenario, representing what each discrete action would look like if executed in that scenario. While our primary objective is to learn representative action sets, these capabilities combine to produce accurate multimodal trajectory predictions as a byproduct. Although our learned action representations closely resemble semantically meaningful categories (e.g., "go straight", "turn left", etc.), our method is entirely self-supervised and does not utilize any manually generated labels or categories. Our method builds upon recent advances in variational inference and deep unsupervised clustering, resulting in full distribution estimates based on deterministic model evaluations.

READ FULL TEXT

page 6

page 8

research
10/25/2017

Multimodal Probabilistic Model-Based Planning for Human-Robot Interaction

This paper presents a method for constructing human-robot interaction po...
research
03/22/2022

Self-Supervised Representation Learning as Multimodal Variational Inference

This paper proposes a probabilistic extension of SimSiam, a recent self-...
research
03/06/2018

Generative Modeling of Multimodal Multi-Human Behavior

This work presents a methodology for modeling and predicting human behav...
research
03/12/2017

Prediction and Control with Temporal Segment Models

We introduce a method for learning the dynamics of complex nonlinear sys...
research
06/27/2021

Building a Video-and-Language Dataset with Human Actions for Multimodal Logical Inference

This paper introduces a new video-and-language dataset with human action...
research
01/12/2018

Deep Episodic Memory: Encoding, Recalling, and Predicting Episodic Experiences for Robot Action Execution

We present a novel deep neural network architecture for representing rob...
research
02/23/2021

Learning Sparse and Meaningful Representations Through Embodiment

How do humans acquire a meaningful understanding of the world with littl...

Please sign up or login with your details

Forgot password? Click here to reset