DeepAI AI Chat
Log In Sign Up

Neural Manifold Ordinary Differential Equations

06/18/2020
by   Aaron Lou, et al.
cornell university
25

To better conform to data geometry, recent deep generative modelling techniques adapt Euclidean constructions to non-Euclidean spaces. In this paper, we study normalizing flows on manifolds. Previous work has developed flow models for specific cases; however, these advancements hand craft layers on a manifold-by-manifold basis, restricting generality and inducing cumbersome design constraints. We overcome these issues by introducing Neural Manifold Ordinary Differential Equations, a manifold generalization of Neural ODEs, which enables the construction of Manifold Continuous Normalizing Flows (MCNFs). MCNFs require only local geometry (therefore generalizing to arbitrary manifolds) and compute probabilities with continuous change of variables (allowing for a simple and expressive flow construction). We find that leveraging continuous manifold dynamics produces a marked improvement for both density estimation and downstream tasks.

READ FULL TEXT

page 8

page 20

page 21

06/11/2020

Neural Ordinary Differential Equations on Manifolds

Normalizing flows are a powerful technique for obtaining reparameterizab...
05/25/2021

Density estimation on low-dimensional manifolds: an inflation-deflation approach

Normalizing Flows (NFs) are universal density estimators based on Neuron...
09/13/2019

Horizontal Flows and Manifold Stochastics in Geometric Deep Learning

We introduce two constructions in geometric deep learning for 1) transpo...
06/18/2020

Riemannian Continuous Normalizing Flows

Normalizing flows have shown great promise for modelling flexible probab...
11/16/2021

Thoughts on the Consistency between Ricci Flow and Neural Network Behavior

The Ricci flow is a partial differential equation for evolving the metri...
10/25/2021

Neural Flows: Efficient Alternative to Neural ODEs

Neural ordinary differential equations describe how values change in tim...

Code Repositories

Neural-Manifold-Ordinary-Differential-Equations

[NeurIPS 2020] Neural Manifold Ordinary Differential Equations (https://arxiv.org/abs/2006.10254)


view repo