Deep Spectral Descriptors: Learning the point-wise correspondence metric via Siamese deep neural networks

10/17/2017
by   Zhiyu Sun, et al.
0

A robust and informative local shape descriptor plays an important role in mesh registration. In this regard, spectral descriptors that are based on the spectrum of the Laplace-Beltrami operator have gained a spotlight among the researchers for the last decade due to their desirable properties, such as isometry invariance. Despite such, however, spectral descriptors often fail to give a correct similarity measure for non-isometric cases where the metric distortion between the models is large. Hence, they are in general not suitable for the registration problems, except for the special cases when the models are near-isometry. In this paper, we investigate a way to develop shape descriptors for non-isometric registration tasks by embedding the spectral shape descriptors into a different metric space where the Euclidean distance between the elements directly indicates the geometric dissimilarity. We design and train a Siamese deep neural network to find such an embedding, where the embedded descriptors are promoted to rearrange based on the geometric similarity. We found our approach can significantly enhance the performance of the conventional spectral descriptors for the non-isometric registration tasks, and outperforms recent state-of-the-art method reported in literature.

READ FULL TEXT

page 6

page 8

page 10

research
10/23/2011

Spectral descriptors for deformable shapes

Informative and discriminative feature descriptors play a fundamental ro...
research
01/08/2019

An Application of Manifold Learning in Global Shape Descriptors

With the rapid expansion of applied 3D computational vision, shape descr...
research
08/05/2021

UPDesc: Unsupervised Point Descriptor Learning for Robust Registration

In this work, we propose UPDesc, an unsupervised method to learn point d...
research
07/17/2020

DH3D: Deep Hierarchical 3D Descriptors for Robust Large-Scale 6DoF Relocalization

For relocalization in large-scale point clouds, we propose the first app...
research
06/21/2021

3D Shape Registration Using Spectral Graph Embedding and Probabilistic Matching

We address the problem of 3D shape registration and we propose a novel t...
research
07/30/2019

Bilateral Operators for Functional Maps

A majority of shape correspondence frameworks are based on devising poin...
research
05/08/2019

Spectral Coarsening of Geometric Operators

We introduce a novel approach to measure the behavior of a geometric ope...

Please sign up or login with your details

Forgot password? Click here to reset