Intrinsic and extrinsic deep learning on manifolds

02/16/2023
by   Yihao Fang, et al.
0

We propose extrinsic and intrinsic deep neural network architectures as general frameworks for deep learning on manifolds. Specifically, extrinsic deep neural networks (eDNNs) preserve geometric features on manifolds by utilizing an equivariant embedding from the manifold to its image in the Euclidean space. Moreover, intrinsic deep neural networks (iDNNs) incorporate the underlying intrinsic geometry of manifolds via exponential and log maps with respect to a Riemannian structure. Consequently, we prove that the empirical risk of the empirical risk minimizers (ERM) of eDNNs and iDNNs converge in optimal rates. Overall, The eDNNs framework is simple and easy to compute, while the iDNNs framework is accurate and fast converging. To demonstrate the utilities of our framework, various simulation studies, and real data analyses are presented with eDNNs and iDNNs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/17/2021

A singular Riemannian geometry approach to Deep Neural Networks I. Theoretical foundations

Deep Neural Networks are widely used for solving complex problems in sev...
research
03/15/2022

Intrinsic Neural Fields: Learning Functions on Manifolds

Neural fields have gained significant attention in the computer vision c...
research
01/21/2018

Curvature-based Comparison of Two Neural Networks

In this paper we show the similarities and differences of two deep neura...
research
12/29/2022

Effects of Data Geometry in Early Deep Learning

Deep neural networks can approximate functions on different types of dat...
research
06/01/2018

Intrinsic Isometric Manifold Learning with Application to Localization

Data living on manifolds commonly appear in many applications. We show t...
research
09/03/2020

Computational Analysis of Deformable Manifolds: from Geometric Modelling to Deep Learning

Leo Tolstoy opened his monumental novel Anna Karenina with the now famou...
research
07/06/2022

The Intrinsic Manifolds of Radiological Images and their Role in Deep Learning

The manifold hypothesis is a core mechanism behind the success of deep l...

Please sign up or login with your details

Forgot password? Click here to reset