ManifoldNorm: Extending normalizations on Riemannian Manifolds

03/30/2020
by   Rudrasis Chakraborty, et al.
0

Many measurements in computer vision and machine learning manifest as non-Euclidean data samples. Several researchers recently extended a number of deep neural network architectures for manifold valued data samples. Researchers have proposed models for manifold valued spatial data which are common in medical image processing including processing of diffusion tensor imaging (DTI) where images are fields of 3× 3 symmetric positive definite matrices or representation in terms of orientation distribution field (ODF) where the identification is in terms of field on hypersphere. There are other sequential models for manifold valued data that recently researchers have shown to be effective for group difference analysis in study for neuro-degenerative diseases. Although, several of these methods are effective to deal with manifold valued data, the bottleneck includes the instability in optimization for deeper networks. In order to deal with these instabilities, researchers have proposed residual connections for manifold valued data. One of the other remedies to deal with the instabilities including gradient explosion is to use normalization techniques including batch norm and group norm etc.. But, so far there is no normalization techniques applicable for manifold valued data. In this work, we propose a general normalization techniques for manifold valued data. We show that our proposed manifold normalization technique have special cases including popular batch norm and group norm techniques. On the experimental side, we focus on two types of manifold valued data including manifold of symmetric positive definite matrices and hypersphere. We show the performance gain in one synthetic experiment for moving MNIST dataset and one real brain image dataset where the representation is in terms of orientation distribution field (ODF).

READ FULL TEXT
research
10/05/2019

Dilated Convolutional Neural Networks for Sequential Manifold-valued Data

Efforts are underway to study ways via which the power of deep neural ne...
research
12/18/2020

Flow-based Generative Models for Learning Manifold to Manifold Mappings

Many measurements or observations in computer vision and machine learnin...
research
03/02/2020

MVC-Net: A Convolutional Neural Network Architecture for Manifold-Valued Images With Applications

Geometric deep learning has attracted significant attention in recent ye...
research
11/19/2019

Learning Weighted Submanifolds with Variational Autoencoders and Riemannian Variational Autoencoders

Manifold-valued data naturally arises in medical imaging. In cognitive n...
research
03/26/2017

Multivariate Regression with Gross Errors on Manifold-valued Data

We consider the topic of multivariate regression on manifold-valued outp...
research
07/28/2016

A Nonlocal Denoising Algorithm for Manifold-Valued Images Using Second Order Statistics

Nonlocal patch-based methods, in particular the Bayes' approach of Lebru...
research
06/07/2021

Neurons on Amoebae

We apply methods of machine-learning, such as neural networks, manifold ...

Please sign up or login with your details

Forgot password? Click here to reset