Tangent Space Backpropagation for 3D Transformation Groups

03/22/2021
by   Zachary Teed, et al.
0

We address the problem of performing backpropagation for computation graphs involving 3D transformation groups SO(3), SE(3), and Sim(3). 3D transformation groups are widely used in 3D vision and robotics, but they do not form vector spaces and instead lie on smooth manifolds. The standard backpropagation approach, which embeds 3D transformations in Euclidean spaces, suffers from numerical difficulties. We introduce a new library, which exploits the group structure of 3D transformations and performs backpropagation in the tangent spaces of manifolds. We show that our approach is numerically more stable, easier to implement, and beneficial to a diverse set of tasks. Our plug-and-play PyTorch library is available at https://github.com/princeton-vl/lietorch.

READ FULL TEXT
10/22/2021

Learning Stable Vector Fields on Lie Groups

Learning robot motions from demonstration requires having models that ar...
10/22/2018

Learning sparse transformations through backpropagation

Many transformations in deep learning architectures are sparsely connect...
12/14/2020

ProLab: perceptually uniform projective colour coordinate system

In this work, we propose proLab: a new colour coordinate system derived ...
02/03/2020

A Code for Unscented Kalman Filtering on Manifolds (UKF-M)

The present paper introduces a novel methodology for Unscented Kalman Fi...
06/21/2019

Backpropagation-Friendly Eigendecomposition

Eigendecomposition (ED) is widely used in deep networks. However, the ba...
02/19/2022

Transformation Coding: Simple Objectives for Equivariant Representations

We present a simple non-generative approach to deep representation learn...
06/06/2019

Visual Backpropagation

We show how a declarative functional programming specification of backpr...

Code Repositories