An Unsupervised Algorithm For Learning Lie Group Transformations

01/07/2010
by   Jascha Sohl-Dickstein, et al.
0

We present several theoretical contributions which allow Lie groups to be fit to high dimensional datasets. Transformation operators are represented in their eigen-basis, reducing the computational complexity of parameter estimation to that of training a linear transformation model. A transformation specific "blurring" operator is introduced that allows inference to escape local minima via a smoothing of the transformation space. A penalty on traversed manifold distance is added which encourages the discovery of sparse, minimal distance, transformations between states. Both learning and inference are demonstrated using these methods for the full set of affine transformations on natural image patches. Transformation operators are then trained on natural video sequences. It is shown that the learned video transformations provide a better description of inter-frame differences than the standard motion model based on rigid translation.

READ FULL TEXT

page 12

page 13

page 14

research
06/22/2021

Learning Identity-Preserving Transformations on Data Manifolds

Many machine learning techniques incorporate identity-preserving transfo...
research
11/16/2019

AETv2: AutoEncoding Transformations for Self-Supervised Representation Learning by Minimizing Geodesic Distances in Lie Groups

Self-supervised learning by predicting transformations has demonstrated ...
research
04/10/2015

Real-time Tool for Affine Transformations of Two Dimensional IFS Fractals

This work introduces a novel tool for interactive, real-time transformat...
research
01/14/2012

G-Lets: Signal Processing Using Transformation Groups

We present an algorithm using transformation groups and their irreducibl...
research
03/13/2022

Similarity Equivariant Linear Transformation of Joint Orientation-Scale Space Representations

Convolution is conventionally defined as a linear operation on functions...
research
02/10/2021

Addressing the Topological Defects of Disentanglement via Distributed Operators

A core challenge in Machine Learning is to learn to disentangle natural ...
research
12/05/2020

Joint Estimation of Image Representations and their Lie Invariants

Images encode both the state of the world and its content. The former is...

Please sign up or login with your details

Forgot password? Click here to reset