3DN: 3D Deformation Network

03/08/2019
by   Weiyue Wang, et al.
0

Applications in virtual and augmented reality create a demand for rapid creation and easy access to large sets of 3D models. An effective way to address this demand is to edit or deform existing 3D models based on a reference, e.g., a 2D image which is very easy to acquire. Given such a source 3D model and a target which can be a 2D image, 3D model, or a point cloud acquired as a depth scan, we introduce 3DN, an end-to-end network that deforms the source model to resemble the target. Our method infers per-vertex offset displacements while keeping the mesh connectivity of the source model fixed. We present a training strategy which uses a novel differentiable operation, mesh sampling operator, to generalize our method across source and target models with varying mesh densities. Mesh sampling operator can be seamlessly integrated into the network to handle meshes with different topologies. Qualitative and quantitative results show that our method generates higher quality results compared to the state-of-the art learning-based methods for 3D shape generation. Code is available at github.com/laughtervv/3DN.

READ FULL TEXT

page 3

page 6

page 7

page 8

research
12/13/2021

N-Cloth: Predicting 3D Cloth Deformation with Mesh-Based Networks

We present a novel mesh-based learning approach (N-Cloth) for plausible ...
research
10/21/2022

Isomorphic mesh generation from point clouds with multilayer perceptrons

We propose a new neural network, called isomorphic mesh generator (iMG),...
research
03/16/2020

Neural Pose Transfer by Spatially Adaptive Instance Normalization

Pose transfer has been studied for decades, in which the pose of a sourc...
research
04/05/2018

Pixel2Mesh: Generating 3D Mesh Models from Single RGB Images

We propose an end-to-end deep learning architecture that produces a 3D s...
research
07/12/2023

Pyramid Deep Fusion Network for Two-Hand Reconstruction from RGB-D Images

Accurately recovering the dense 3D mesh of both hands from monocular ima...
research
11/13/2019

SpiralNet++: A Fast and Highly Efficient Mesh Convolution Operator

Intrinsic graph convolution operators with differentiable kernel functio...
research
03/11/2022

Mechanical Characterization of Compliant Cellular Robots. Part I: Passive Stiffness

Modular Active Cell Robots (MACROs) are a design paradigm for modular ro...

Please sign up or login with your details

Forgot password? Click here to reset