Log In Sign Up

Continuous Geodesic Convolutions for Learning on 3D Shapes

by   Zhangsihao Yang, et al.

The majority of descriptor-based methods for geometric processing of non-rigid shape rely on hand-crafted descriptors. Recently, learning-based techniques have been shown effective, achieving state-of-the-art results in a variety of tasks. Yet, even though these methods can in principle work directly on raw data, most methods still rely on hand-crafted descriptors at the input layer. In this work, we wish to challenge this practice and use a neural network to learn descriptors directly from the raw mesh. To this end, we introduce two modules into our neural architecture. The first is a local reference frame (LRF) used to explicitly make the features invariant to rigid transformations. The second is continuous convolution kernels that provide robustness to sampling. We show the efficacy of our proposed network in learning on raw meshes using two cornerstone tasks: shape matching, and human body parts segmentation. Our results show superior results over baseline methods that use hand-crafted descriptors.


page 8

page 9


Learning an Effective Equivariant 3D Descriptor Without Supervision

Establishing correspondences between 3D shapes is a fundamental task in ...

Collaborative Descriptors: Convolutional Maps for Preprocessing

The paper presents a novel concept for collaborative descriptors between...

Lattice Convolutional Networks for Learning Ground States of Quantum Many-Body Systems

Deep learning methods have been shown to be effective in representing gr...

Deep Shape Analysis on Abdominal Organs for Diabetes Prediction

Morphological analysis of organs based on images is a key task in medica...

Learning Spectral Transform Network on 3D Surface for Non-rigid Shape Analysis

Designing a network on 3D surface for non-rigid shape analysis is a chal...

Deep Multi-Structural Shape Analysis: Application to Neuroanatomy

We propose a deep neural network for supervised learning on neuroanatomi...

Learned versus Hand-Designed Feature Representations for 3d Agglomeration

For image recognition and labeling tasks, recent results suggest that ma...