GeoCode: Interpretable Shape Programs

12/19/2022
by   Ofek Pearl, et al.
0

Mapping high-fidelity 3D geometry to a representation that allows for intuitive edits remains an elusive goal in computer vision and graphics. The key challenge is the need to model both continuous and discrete shape variations. Current approaches, such as implicit shape representation, lack straightforward interpretable encoding, while others that employ procedural methods output coarse geometry. We present GeoCode, a technique for 3D shape synthesis using an intuitively editable parameter space. We build a novel program that enforces a complex set of rules and enables users to perform intuitive and controlled high-level edits that procedurally propagate at a low level to the entire shape. Our program produces high-quality mesh outputs by construction. We use a neural network to map a given point cloud or sketch to our interpretable parameter space. Once produced by our procedural program, shapes can be easily modified. Empirically, we show that GeoCode can infer and recover 3D shapes more accurately compared to existing techniques and we demonstrate its ability to perform controlled local and global shape manipulations.

READ FULL TEXT

page 3

page 7

page 8

page 12

page 15

research
01/09/2019

Learning to Infer and Execute 3D Shape Programs

Human perception of 3D shapes goes beyond reconstructing them as a set o...
research
09/17/2020

ShapeAssembly: Learning to Generate Programs for 3D Shape Structure Synthesis

Manually authoring 3D shapes is difficult and time consuming; generative...
research
01/16/2019

DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation

Computer graphics, 3D computer vision and robotics communities have prod...
research
08/12/2020

DSM-Net: Disentangled Structured Mesh Net for Controllable Generation of Fine Geometry

3D shape generation is a fundamental operation in computer graphics. Whi...
research
08/05/2021

SimpModeling: Sketching Implicit Field to Guide Mesh Modeling for 3D Animalmorphic Head Design

Head shapes play an important role in 3D character design. In this work,...
research
12/25/2022

Neural Shape Compiler: A Unified Framework for Transforming between Text, Point Cloud, and Program

3D shapes have complementary abstractions from low-level geometry to par...
research
12/09/2022

LoopDraw: a Loop-Based Autoregressive Model for Shape Synthesis and Editing

There is no settled universal 3D representation for geometry with many a...

Please sign up or login with your details

Forgot password? Click here to reset