Topology-Preserving Shape Reconstruction and Registration via Neural Diffeomorphic Flow

03/16/2022
by   Shanlin Sun, et al.
3

Deep Implicit Functions (DIFs) represent 3D geometry with continuous signed distance functions learned through deep neural nets. Recently DIFs-based methods have been proposed to handle shape reconstruction and dense point correspondences simultaneously, capturing semantic relationships across shapes of the same class by learning a DIFs-modeled shape template. These methods provide great flexibility and accuracy in reconstructing 3D shapes and inferring correspondences. However, the point correspondences built from these methods do not intrinsically preserve the topology of the shapes, unlike mesh-based template matching methods. This limits their applications on 3D geometries where underlying topological structures exist and matter, such as anatomical structures in medical images. In this paper, we propose a new model called Neural Diffeomorphic Flow (NDF) to learn deep implicit shape templates, representing shapes as conditional diffeomorphic deformations of templates, intrinsically preserving shape topologies. The diffeomorphic deformation is realized by an auto-decoder consisting of Neural Ordinary Differential Equation (NODE) blocks that progressively map shapes to implicit templates. We conduct extensive experiments on several medical image organ segmentation datasets to evaluate the effectiveness of NDF on reconstructing and aligning shapes. NDF achieves consistently state-of-the-art organ shape reconstruction and registration results in both accuracy and quality. The source code is publicly available at https://github.com/Siwensun/Neural_Diffeomorphic_Flow–NDF.

READ FULL TEXT

page 8

page 14

page 15

page 16

page 17

page 18

page 19

page 20

research
11/30/2020

Deep Implicit Templates for 3D Shape Representation

Deep implicit functions (DIFs), as a kind of 3D shape representation, ar...
research
09/14/2022

Landmark-free Statistical Shape Modeling via Neural Flow Deformations

Statistical shape modeling aims at capturing shape variations of an anat...
research
11/26/2021

Neural Fields as Learnable Kernels for 3D Reconstruction

We present Neural Kernel Fields: a novel method for reconstructing impli...
research
04/12/2019

Learning Shape Templates with Structured Implicit Functions

Template 3D shapes are useful for many tasks in graphics and vision, inc...
research
07/14/2022

Learning Implicit Templates for Point-Based Clothed Human Modeling

We present FITE, a First-Implicit-Then-Explicit framework for modeling h...
research
08/13/2019

Learning elementary structures for 3D shape generation and matching

We propose to represent shapes as the deformation and combination of lea...
research
11/12/2022

Structure-Preserving 3D Garment Modeling with Neural Sewing Machines

3D Garment modeling is a critical and challenging topic in the area of c...

Please sign up or login with your details

Forgot password? Click here to reset