Learning an Effective Equivariant 3D Descriptor Without Supervision

09/15/2019
by   Riccardo Spezialetti, et al.
0

Establishing correspondences between 3D shapes is a fundamental task in 3D Computer Vision, typically addressed by matching local descriptors. Recently, a few attempts at applying the deep learning paradigm to the task have shown promising results. Yet, the only explored way to learn rotation invariant descriptors has been to feed neural networks with highly engineered and invariant representations provided by existing hand-crafted descriptors, a path that goes in the opposite direction of end-to-end learning from raw data so successfully deployed for 2D images. In this paper, we explore the benefits of taking a step back in the direction of end-to-end learning of 3D descriptors by disentangling the creation of a robust and distinctive rotation equivariant representation, which can be learned from unoriented input data, and the definition of a good canonical orientation, required only at test time to obtain an invariant descriptor. To this end, we leverage two recent innovations: spherical convolutional neural networks to learn an equivariant descriptor and plane folding decoders to learn without supervision. The effectiveness of the proposed approach is experimentally validated by outperforming hand-crafted and learned descriptors on a standard benchmark.

READ FULL TEXT
research
02/06/2020

Continuous Geodesic Convolutions for Learning on 3D Shapes

The majority of descriptor-based methods for geometric processing of non...
research
10/31/2017

Image Patch Matching Using Convolutional Descriptors with Euclidean Distance

In this work we propose a neural network based image descriptor suitable...
research
12/06/2019

Tree bark re-identification using a deep-learning feature descriptor

The ability to visually re-identify objects is a fundamental capability ...
research
03/20/2018

Hierarchical Metric Learning and Matching for 2D and 3D Geometric Correspondences

Interest point descriptors have fueled progress on almost every problem ...
research
01/19/2021

Hyperdimensional computing as a framework for systematic aggregation of image descriptors

Image and video descriptors are an omnipresent tool in computer vision a...
research
05/10/2017

Collaborative Descriptors: Convolutional Maps for Preprocessing

The paper presents a novel concept for collaborative descriptors between...
research
03/15/2023

From Local Binary Patterns to Pixel Difference Networks for Efficient Visual Representation Learning

LBP is a successful hand-crafted feature descriptor in computer vision. ...

Please sign up or login with your details

Forgot password? Click here to reset