Horizontal Flows and Manifold Stochastics in Geometric Deep Learning

09/13/2019
by   Stefan Sommer, et al.
6

We introduce two constructions in geometric deep learning for 1) transporting orientation-dependent convolutional filters over a manifold in a continuous way and thereby defining a convolution operator that naturally incorporates the rotational effect of holonomy; and 2) allowing efficient evaluation of manifold convolution layers by sampling manifold valued random variables that center around a weighted Brownian motion maximum likelihood mean. Both methods are inspired by stochastics on manifolds and geometric statistics, and provide examples of how stochastic methods -- here horizontal frame bundle flows and non-linear bridge sampling schemes, can be used in geometric deep learning. We outline the theoretical foundation of the two methods, discuss their relation to Euclidean deep networks and existing methodology in geometric deep learning, and establish important properties of the proposed constructions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/01/2017

Stochastic Development Regression on Non-Linear Manifolds

We introduce a regression model for data on non-linear manifolds. The mo...
research
10/05/2021

Turing approximations, toric isometric embeddings manifold convolutions

Convolutions are fundamental elements in deep learning architectures. He...
research
06/18/2020

Neural Manifold Ordinary Differential Equations

To better conform to data geometry, recent deep generative modelling tec...
research
11/20/2022

Convolutional Filtering on Sampled Manifolds

The increasing availability of geometric data has motivated the need for...
research
02/14/2022

Principal Manifold Flows

Normalizing flows map an independent set of latent variables to their sa...
research
05/21/2019

Geometry of Deep Convolutional Networks

We give a formal procedure for computing preimages of convolutional netw...
research
05/26/2018

Geometric Understanding of Deep Learning

Deep learning is the mainstream technique for many machine learning task...

Please sign up or login with your details

Forgot password? Click here to reset