Deep Deformable Models: Learning 3D Shape Abstractions with Part Consistency

09/02/2023
by   Di Liu, et al.
0

The task of shape abstraction with semantic part consistency is challenging due to the complex geometries of natural objects. Recent methods learn to represent an object shape using a set of simple primitives to fit the target. However, in these methods, the primitives used do not always correspond to real parts or lack geometric flexibility for semantic interpretation. In this paper, we investigate salient and efficient primitive descriptors for accurate shape abstractions, and propose Deep Deformable Models (DDMs). DDM employs global deformations and diffeomorphic local deformations. These properties enable DDM to abstract complex object shapes with significantly fewer primitives that offer broader geometry coverage and finer details. DDM is also capable of learning part-level semantic correspondences due to the differentiable and invertible properties of our primitive deformation. Moreover, DDM learning formulation is based on dynamic and kinematic modeling, which enables joint regularization of each sub-transformation during primitive fitting. Extensive experiments on ShapeNet demonstrate that DDM outperforms the state-of-the-art in terms of reconstruction and part consistency by a notable margin.

READ FULL TEXT
research
03/18/2021

Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networks

Impressive progress in 3D shape extraction led to representations that c...
research
08/25/2023

DPF-Net: Combining Explicit Shape Priors in Deformable Primitive Field for Unsupervised Structural Reconstruction of 3D Objects

Unsupervised methods for reconstructing structures face significant chal...
research
03/28/2022

Primitive-based Shape Abstraction via Nonparametric Bayesian Inference

3D shape abstraction has drawn great interest over the years. Apart from...
research
12/01/2016

Learning Shape Abstractions by Assembling Volumetric Primitives

We present a learning framework for abstracting complex shapes by learni...
research
10/21/2020

Neural Star Domain as Primitive Representation

Reconstructing 3D objects from 2D images is a fundamental task in comput...
research
05/15/2020

PrimiTect: Fast Continuous Hough Voting for Primitive Detection

This paper tackles the problem of data abstraction in the context of 3D ...
research
07/31/2023

Part-level Scene Reconstruction Affords Robot Interaction

Existing methods for reconstructing interactive scenes primarily focus o...

Please sign up or login with your details

Forgot password? Click here to reset