ResNet-LDDMM: Advancing the LDDMM Framework Using Deep Residual Networks

02/16/2021
by   Boulbaba Ben Amor, et al.
12

In deformable registration, the geometric framework - large deformation diffeomorphic metric mapping or LDDMM, in short - has inspired numerous techniques for comparing, deforming, averaging and analyzing shapes or images. Grounded in flows, which are akin to the equations of motion used in fluid dynamics, LDDMM algorithms solve the flow equation in the space of plausible deformations, i.e. diffeomorphisms. In this work, we make use of deep residual neural networks to solve the non-stationary ODE (flow equation) based on a Euler's discretization scheme. The central idea is to represent time-dependent velocity fields as fully connected ReLU neural networks (building blocks) and derive optimal weights by minimizing a regularized loss function. Computing minimizing paths between deformations, thus between shapes, turns to find optimal network parameters by back-propagating over the intermediate building blocks. Geometrically, at each time step, ResNet-LDDMM searches for an optimal partition of the space into multiple polytopes, and then computes optimal velocity vectors as affine transformations on each of these polytopes. As a result, different parts of the shape, even if they are close (such as two fingers of a hand), can be made to belong to different polytopes, and therefore be moved in different directions without costing too much energy. Importantly, we show how diffeomorphic transformations, or more precisely bilipshitz transformations, are predicted by our algorithm. We illustrate these ideas on diverse registration problems of 3D shapes under complex topology-preserving transformations. We thus provide essential foundations for more advanced shape variability analysis under a novel joint geometric-neural networks Riemannian-like framework, i.e. ResNet-LDDMM.

READ FULL TEXT

page 5

page 6

page 9

page 10

page 11

page 12

page 13

page 15

research
06/22/2021

Residual Networks as Flows of Velocity Fields for Diffeomorphic Time Series Alignment

Non-linear (large) time warping is a challenging source of nuisance in t...
research
08/10/2020

Do ideas have shape? Plato's theory of forms as the continuous limit of artificial neural networks

We show that ResNets converge, in the infinite depth limit, to a general...
research
11/13/2018

Data Driven Governing Equations Approximation Using Deep Neural Networks

We present a numerical framework for approximating unknown governing equ...
research
10/02/2012

Discrete geodesic calculus in the space of viscous fluidic objects

Based on a local approximation of the Riemannian distance on a manifold ...
research
08/21/2017

A Flow Model of Neural Networks

Based on a natural connection between ResNet and transport equation or i...
research
09/25/2016

Fast Blended Transformations for Partial Shape Registration

Automatic estimation of skinning transformations is a popular way to def...
research
06/12/2023

Polyhedral Complex Extraction from ReLU Networks using Edge Subdivision

A neural network consisting of piecewise affine building blocks, such as...

Please sign up or login with your details

Forgot password? Click here to reset