GA-Sketching: Shape Modeling from Multi-View Sketching with Geometry-Aligned Deep Implicit Functions

09/12/2023
by   Jie Zhou, et al.
0

Sketch-based shape modeling aims to bridge the gap between 2D drawing and 3D modeling by providing an intuitive and accessible approach to create 3D shapes from 2D sketches. However, existing methods still suffer from limitations in reconstruction quality and multi-view interaction friendliness, hindering their practical application. This paper proposes a faithful and user-friendly iterative solution to tackle these limitations by learning geometry-aligned deep implicit functions from one or multiple sketches. Our method lifts 2D sketches to volume-based feature tensors, which align strongly with the output 3D shape, enabling accurate reconstruction and faithful editing. Such a geometry-aligned feature encoding technique is well-suited to iterative modeling since features from different viewpoints can be easily memorized or aggregated. Based on these advantages, we design a unified interactive system for sketch-based shape modeling. It enables users to generate the desired geometry iteratively by drawing sketches from any number of viewpoints. In addition, it allows users to edit the generated surface by making a few local modifications. We demonstrate the effectiveness and practicality of our method with extensive experiments and user studies, where we found that our method outperformed existing methods in terms of accuracy, efficiency, and user satisfaction. The source code of this project is available at https://github.com/LordLiang/GA-Sketching.

READ FULL TEXT
research
07/26/2017

What You Sketch Is What You Get: 3D Sketching using Multi-View Deep Volumetric Prediction

Sketch-based modeling strives to bring the ease and immediacy of drawing...
research
07/26/2017

3D Sketching using Multi-View Deep Volumetric Prediction

Sketch-based modeling strives to bring the ease and immediacy of drawing...
research
06/09/2023

SENS: Sketch-based Implicit Neural Shape Modeling

We present SENS, a novel method for generating and editing 3D models fro...
research
03/14/2022

VPFusion: Joint 3D Volume and Pixel-Aligned Feature Fusion for Single and Multi-view 3D Reconstruction

We introduce a unified single and multi-view neural implicit 3D reconstr...
research
02/28/2023

HelixSurf: A Robust and Efficient Neural Implicit Surface Learning of Indoor Scenes with Iterative Intertwined Regularization

Recovery of an underlying scene geometry from multiview images stands as...
research
06/26/2014

DASS: Detail Aware Sketch-Based Surface Modeling

We present a sketch-based modeling system suitable for detail editing, b...
research
03/31/2023

VDN-NeRF: Resolving Shape-Radiance Ambiguity via View-Dependence Normalization

We propose VDN-NeRF, a method to train neural radiance fields (NeRFs) fo...

Please sign up or login with your details

Forgot password? Click here to reset