StructEdit: Learning Structural Shape Variations

by   Kaichun Mo, et al.

Learning to encode differences in the geometry and (topological) structure of the shapes of ordinary objects is key to generating semantically plausible variations of a given shape, transferring edits from one shape to another, and many other applications in 3D content creation. The common approach of encoding shapes as points in a high-dimensional latent feature space suggests treating shape differences as vectors in that space. Instead, we treat shape differences as primary objects in their own right and propose to encode them in their own latent space. In a setting where the shapes themselves are encoded in terms of fine-grained part hierarchies, we demonstrate that a separate encoding of shape deltas or differences provides a principled way to deal with inhomogeneities in the shape space due to different combinatorial part structures, while also allowing for compactness in the representation, as well as edit abstraction and transfer. Our approach is based on a conditional variational autoencoder for encoding and decoding shape deltas, conditioned on a source shape. We demonstrate the effectiveness and robustness of our approach in multiple shape modification and generation tasks, and provide comparison and ablation studies on the PartNet dataset, one of the largest publicly available 3D datasets.


page 2

page 3

page 4

page 5

page 7

page 9

page 10

page 12


LOGAN: Unpaired Shape Transform in Latent Overcomplete Space

We present LOGAN, a deep neural network aimed at learning generic shape ...

Learning Part Generation and Assembly for Structure-aware Shape Synthesis

Learning deep generative models for 3D shape synthesis is largely limite...

On the Effectiveness of Weight-Encoded Neural Implicit 3D Shapes

A neural implicit outputs a number indicating whether the given query po...

Generating various airfoil shapes with required lift coefficient using conditional variational autoencoders

Multiple shapes must be obtained in the mechanical design process to sat...

Structure-aware Generative Network for 3D-Shape Modeling

We present SAGNet, a structure-aware generative model for 3D shapes. Giv...

Shape complexity estimation using VAE

In this paper, we compare methods for estimating the complexity of two-d...

GRASS: Generative Recursive Autoencoders for Shape Structures

We introduce a novel neural network architecture for encoding and synthe...

Please sign up or login with your details

Forgot password? Click here to reset