Evaluating 3D Shape Analysis Methods for Robustness to Rotation Invariance

05/29/2023
by   Supriya Gadi Patil, et al.
0

This paper analyzes the robustness of recent 3D shape descriptors to SO(3) rotations, something that is fundamental to shape modeling. Specifically, we formulate the task of rotated 3D object instance detection. To do so, we consider a database of 3D indoor scenes, where objects occur in different orientations. We benchmark different methods for feature extraction and classification in the context of this task. We systematically contrast different choices in a variety of experimental settings investigating the impact on the performance of different rotation distributions, different degrees of partial observations on the object, and the different levels of difficulty of negative pairs. Our study, on a synthetic dataset of 3D scenes where objects instances occur in different orientations, reveals that deep learning-based rotation invariant methods are effective for relatively easy settings with easy-to-distinguish pairs. However, their performance decreases significantly when the difference in rotations on the input pair is large, or when the degree of observation of input objects is reduced, or the difficulty level of input pair is increased. Finally, we connect feature encodings designed for rotation-invariant methods to 3D geometry that enable them to acquire the property of rotation invariance.

READ FULL TEXT
research
12/31/2022

Rethinking Rotation Invariance with Point Cloud Registration

Recent investigations on rotation invariance for 3D point clouds have be...
research
02/06/2023

PaRot: Patch-Wise Rotation-Invariant Network via Feature Disentanglement and Pose Restoration

Recent interest in point cloud analysis has led rapid progress in design...
research
08/24/2023

VNI-Net: Vector Neurons-based Rotation-Invariant Descriptor for LiDAR Place Recognition

LiDAR-based place recognition plays a crucial role in Simultaneous Local...
research
12/04/2015

What can we learn about CNNs from a large scale controlled object dataset?

Tolerance to image variations (e.g. translation, scale, pose, illuminati...
research
04/28/2022

Rotationally Equivariant 3D Object Detection

Rotation equivariance has recently become a strongly desired property in...
research
08/09/2023

Self-supervised Learning of Rotation-invariant 3D Point Set Features using Transformer and its Self-distillation

Invariance against rotations of 3D objects is an important property in a...
research
10/20/2019

Endowing Deep 3D Models with Rotation Invariance Based on Principal Component Analysis

In this paper, we propose a simple yet effective method to endow deep 3D...

Please sign up or login with your details

Forgot password? Click here to reset