DPC: Unsupervised Deep Point Correspondence via Cross and Self Construction

by   Itai Lang, et al.

We present a new method for real-time non-rigid dense correspondence between point clouds based on structured shape construction. Our method, termed Deep Point Correspondence (DPC), requires a fraction of the training data compared to previous techniques and presents better generalization capabilities. Until now, two main approaches have been suggested for the dense correspondence problem. The first is a spectral-based approach that obtains great results on synthetic datasets but requires mesh connectivity of the shapes and long inference processing time while being unstable in real-world scenarios. The second is a spatial approach that uses an encoder-decoder framework to regress an ordered point cloud for the matching alignment from an irregular input. Unfortunately, the decoder brings considerable disadvantages, as it requires a large amount of training data and struggles to generalize well in cross-dataset evaluations. DPC's novelty lies in its lack of a decoder component. Instead, we use latent similarity and the input coordinates themselves to construct the point cloud and determine correspondence, replacing the coordinate regression done by the decoder. Extensive experiments show that our construction scheme leads to a performance boost in comparison to recent state-of-the-art correspondence methods. Our code is publicly available at https://github.com/dvirginz/DPC.


page 1

page 6

page 13

page 14


PointAttN: You Only Need Attention for Point Cloud Completion

Point cloud completion referring to completing 3D shapes from partial 3D...

SCOOP: Self-Supervised Correspondence and Optimization-Based Scene Flow

Scene flow estimation is a long-standing problem in computer vision, whe...

Searching Dense Point Correspondences via Permutation Matrix Learning

Although 3D point cloud data has received widespread attentions as a gen...

Unsupervised 3D Human Mesh Recovery from Noisy Point Clouds

This paper presents a novel unsupervised approach to reconstruct human s...

CorrNet3D: Unsupervised End-to-end Learning of Dense Correspondence for 3D Point Clouds

This paper addresses the problem of computing dense correspondence betwe...

Pyramid Deep Fusion Network for Two-Hand Reconstruction from RGB-D Images

Accurately recovering the dense 3D mesh of both hands from monocular ima...

Correspondence Learning via Linearly-invariant Embedding

In this paper, we propose a fully differentiable pipeline for estimating...

Please sign up or login with your details

Forgot password? Click here to reset