Synergizing Contrastive Learning and Optimal Transport for 3D Point Cloud Domain Adaptation

by   Siddharth Katageri, et al.

Recently, the fundamental problem of unsupervised domain adaptation (UDA) on 3D point clouds has been motivated by a wide variety of applications in robotics, virtual reality, and scene understanding, to name a few. The point cloud data acquisition procedures manifest themselves as significant domain discrepancies and geometric variations among both similar and dissimilar classes. The standard domain adaptation methods developed for images do not directly translate to point cloud data because of their complex geometric nature. To address this challenge, we leverage the idea of multimodality and alignment between distributions. We propose a new UDA architecture for point cloud classification that benefits from multimodal contrastive learning to get better class separation in both domains individually. Further, the use of optimal transport (OT) aims at learning source and target data distributions jointly to reduce the cross-domain shift and provide a better alignment. We conduct a comprehensive empirical study on PointDA-10 and GraspNetPC-10 and show that our method achieves state-of-the-art performance on GraspNetPC-10 (with approx 4-12 ablation studies and decision boundary analysis also validate the significance of our contrastive learning module and OT alignment.


page 7

page 12

page 13

page 14

page 15

page 16

page 17

page 18


Multi-source Domain Adaptation via Weighted Joint Distributions Optimal Transport

The problem of domain adaptation on an unlabeled target dataset using kn...

PointDAN: A Multi-Scale 3D Domain Adaption Network for Point Cloud Representation

Domain Adaptation (DA) approaches achieved significant improvements in a...

A Learnable Self-supervised Task for Unsupervised Domain Adaptation on Point Clouds

Deep neural networks have achieved promising performance in supervised p...

Compositional Semantic Mix for Domain Adaptation in Point Cloud Segmentation

Deep-learning models for 3D point cloud semantic segmentation exhibit li...

Self-Distillation for Unsupervised 3D Domain Adaptation

Point cloud classification is a popular task in 3D vision. However, prev...

Feature Selection for Unsupervised Domain Adaptation using Optimal Transport

In this paper, we propose a new feature selection method for unsupervise...

sat2pc: Estimating Point Cloud of Building Roofs from 2D Satellite Images

Three-dimensional (3D) urban models have gained interest because of thei...

Please sign up or login with your details

Forgot password? Click here to reset