Equivariant Deep Dynamical Model for Motion Prediction

11/02/2021
by   Bahar Azari, et al.
0

Learning representations through deep generative modeling is a powerful approach for dynamical modeling to discover the most simplified and compressed underlying description of the data, to then use it for other tasks such as prediction. Most learning tasks have intrinsic symmetries, i.e., the input transformations leave the output unchanged, or the output undergoes a similar transformation. The learning process is, however, usually uninformed of these symmetries. Therefore, the learned representations for individually transformed inputs may not be meaningfully related. In this paper, we propose an SO(3) equivariant deep dynamical model (EqDDM) for motion prediction that learns a structured representation of the input space in the sense that the embedding varies with symmetry transformations. EqDDM is equipped with equivariant networks to parameterize the state-space emission and transition models. We demonstrate the superior predictive performance of the proposed model on various motion data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/17/2020

Learning Group Structure and Disentangled Representations of Dynamical Environments

Discovering the underlying structure of a dynamical environment involves...
research
03/31/2023

Learning Internal Representations of 3D Transformations from 2D Projected Inputs

When interacting in a three dimensional world, humans must estimate 3D s...
research
09/15/2023

Sampling-Free Probabilistic Deep State-Space Models

Many real-world dynamical systems can be described as State-Space Models...
research
04/24/2022

Learning Symmetric Embeddings for Equivariant World Models

Incorporating symmetries can lead to highly data-efficient and generaliz...
research
11/01/2018

Deep Structured Prediction with Nonlinear Output Transformations

Deep structured models are widely used for tasks like semantic segmentat...
research
11/08/2019

Discovering Invariances in Healthcare Neural Networks

We study the invariance characteristics of pre-trained predictive models...
research
06/18/2021

Dynamical Deep Generative Latent Modeling of 3D Skeletal Motion

In this paper, we propose a Bayesian switching dynamical model for segme...

Please sign up or login with your details

Forgot password? Click here to reset