CD^2: Fine-grained 3D Mesh Reconstruction with Twice Chamfer Distance

06/01/2022
by   Rongfei Zeng, et al.
0

Monocular 3D reconstruction is to reconstruct the shape of object and its other detailed information from a single RGB image. In 3D reconstruction, polygon mesh is the most prevalent expression form obtained from deep learning models, with detailed surface information and low computational cost. However, some state-of-the-art works fail to generate well-structured meshes, these meshes have two severe problems which we call Vertices Clustering and Illegal Twist. By delving into the mesh deformation procedure, we pinpoint the inadequate usage of Chamfer Distance(CD) metric in deep learning model. In this paper, we initially demonstrate the problems resulting from CD with visual examples and quantitative analyses. To solve these problems, we propose a fine-grained reconstruction method CD^2 with Chamfer distance adopted twice to perform a plausible and adaptive deformation. Extensive experiments on two 3D datasets and the comparison of our newly proposed mesh quality metrics demonstrate that our CD^2 outperforms others by generating better-structured meshes.

READ FULL TEXT

page 2

page 11

page 12

page 14

page 16

research
11/29/2017

Image2Mesh: A Learning Framework for Single Image 3D Reconstruction

One challenge that remains open in 3D deep learning is how to efficientl...
research
09/01/2019

Deep Mesh Reconstruction from Single RGB Images via Topology Modification Networks

Reconstructing the 3D mesh of a general object from a single image is no...
research
08/14/2019

Directional TSDF: Modeling Surface Orientation for Coherent Meshes

Real-time 3D reconstruction from RGB-D sensor data plays an important ro...
research
12/05/2022

Low Power Mesh Algorithms for Image Problems

We analyze a physically motivated fine-grained mesh-connected computer m...
research
07/22/2019

DeepOrganNet: On-the-Fly Reconstruction and Visualization of 3D / 4D Lung Models from Single-View Projections by Deep Deformation Network

This paper introduces a deep neural network based method, i.e., DeepOrga...
research
04/14/2023

CornerFormer: Boosting Corner Representation for Fine-Grained Structured Reconstruction

Structured reconstruction is a non-trivial dense prediction problem, whi...
research
09/13/2021

Interactive All-Hex Meshing via Cuboid Decomposition

Standard PolyCube-based hexahedral (hex) meshing methods aim to deform t...

Please sign up or login with your details

Forgot password? Click here to reset