Learning to Infer Semantic Parameters for 3D Shape Editing

11/09/2020
by   Fangyin Wei, et al.
6

Many applications in 3D shape design and augmentation require the ability to make specific edits to an object's semantic parameters (e.g., the pose of a person's arm or the length of an airplane's wing) while preserving as much existing details as possible. We propose to learn a deep network that infers the semantic parameters of an input shape and then allows the user to manipulate those parameters. The network is trained jointly on shapes from an auxiliary synthetic template and unlabeled realistic models, ensuring robustness to shape variability while relieving the need to label realistic exemplars. At testing time, edits within the parameter space drive deformations to be applied to the original shape, which provides semantically-meaningful manipulation while preserving the details. This is in contrast to prior methods that either use autoencoders with a limited latent-space dimensionality, failing to preserve arbitrary detail, or drive deformations with purely-geometric controls, such as cages, losing the ability to update local part regions. Experiments with datasets of chairs, airplanes, and human bodies demonstrate that our method produces more natural edits than prior work.

READ FULL TEXT

page 6

page 7

page 12

page 13

page 15

page 17

page 19

page 20

research
04/06/2020

DualSDF: Semantic Shape Manipulation using a Two-Level Representation

We are seeing a Cambrian explosion of 3D shape representations for use i...
research
04/22/2021

Cross-Domain and Disentangled Face Manipulation with 3D Guidance

Face image manipulation via three-dimensional guidance has been widely a...
research
06/11/2018

Latent Space Representation for Shape Analysis and Learning

We propose a novel shape representation useful for analyzing and process...
research
12/04/2021

Sphere Face Model:A 3D Morphable Model with Hypersphere Manifold Latent Space

3D Morphable Models (3DMMs) are generative models for face shape and app...
research
05/06/2019

FaceShapeGene: A Disentangled Shape Representation for Flexible Face Image Editing

Existing methods for face image manipulation generally focus on editing ...
research
08/04/2021

Learning to generate shape from global-local spectra

In this work, we present a new learning-based pipeline for the generatio...
research
11/29/2022

Wearing the Same Outfit in Different Ways – A Controllable Virtual Try-on Method

An outfit visualization method generates an image of a person wearing re...

Please sign up or login with your details

Forgot password? Click here to reset