Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapes

03/10/2019
by   Xiaogang Wang, et al.
0

For the task of mobility analysis of 3D shapes, we propose joint analysis for simultaneous motion part segmentation and motion attribute estimation, taking a single 3D model as input. The problem is significantly different from those tackled in the existing works which assume the availability of either a pre-existing shape segmentation or multiple 3D models in different motion states. To that end, we develop Shape2Motion which takes a single 3D point cloud as input, and jointly computes a mobility-oriented segmentation and the associated motion attributes. Shape2Motion is comprised of two deep neural networks designed for mobility proposal generation and mobility optimization, respectively. The key contribution of these networks is the novel motion-driven features and losses used in both motion part segmentation and motion attribute estimation. This is based on the observation that the movement of a functional part preserves the shape structure. We evaluate Shape2Motion with a newly proposed benchmark for mobility analysis of 3D shapes. Results demonstrate that our method achieves the state-of-the-art performance both in terms of motion part segmentation and motion attribute estimation.

READ FULL TEXT
research
10/20/2020

Self-Supervised Learning of Part Mobility from Point Cloud Sequence

Part mobility analysis is a significant aspect required to achieve a fun...
research
09/19/2018

Deep Part Induction from Articulated Object Pairs

Object functionality is often expressed through part articulation -- as ...
research
06/07/2021

Unsupervised Learning for Cuboid Shape Abstraction via Joint Segmentation from Point Clouds

Representing complex 3D objects as simple geometric primitives, known as...
research
05/25/2018

Deep Functional Dictionaries: Learning Consistent Semantic Structures on 3D Models from Functions

Various 3D semantic attributes such as segmentation masks, geometric fea...
research
07/31/2023

Towards Unbalanced Motion: Part-Decoupling Network for Video Portrait Segmentation

Video portrait segmentation (VPS), aiming at segmenting prominent foregr...
research
03/24/2022

Quantum Motion Segmentation

Motion segmentation is a challenging problem that seeks to identify inde...
research
05/22/2019

Robust Motion Segmentation from Pairwise Matches

In this paper we address a classification problem that has not been cons...

Please sign up or login with your details

Forgot password? Click here to reset