DeepAI AI Chat
Log In Sign Up

CD^2: Fine-grained 3D Mesh Reconstruction with Twice Chamfer Distance

06/01/2022
by   Rongfei Zeng, et al.
Northeastern University
0

Monocular 3D reconstruction is to reconstruct the shape of object and its other detailed information from a single RGB image. In 3D reconstruction, polygon mesh is the most prevalent expression form obtained from deep learning models, with detailed surface information and low computational cost. However, some state-of-the-art works fail to generate well-structured meshes, these meshes have two severe problems which we call Vertices Clustering and Illegal Twist. By delving into the mesh deformation procedure, we pinpoint the inadequate usage of Chamfer Distance(CD) metric in deep learning model. In this paper, we initially demonstrate the problems resulting from CD with visual examples and quantitative analyses. To solve these problems, we propose a fine-grained reconstruction method CD^2 with Chamfer distance adopted twice to perform a plausible and adaptive deformation. Extensive experiments on two 3D datasets and the comparison of our newly proposed mesh quality metrics demonstrate that our CD^2 outperforms others by generating better-structured meshes.

READ FULL TEXT

page 2

page 11

page 12

page 14

page 16

11/29/2017

Image2Mesh: A Learning Framework for Single Image 3D Reconstruction

One challenge that remains open in 3D deep learning is how to efficientl...
09/01/2019

Deep Mesh Reconstruction from Single RGB Images via Topology Modification Networks

Reconstructing the 3D mesh of a general object from a single image is no...
08/14/2019

Directional TSDF: Modeling Surface Orientation for Coherent Meshes

Real-time 3D reconstruction from RGB-D sensor data plays an important ro...
12/05/2022

Low Power Mesh Algorithms for Image Problems

We analyze a physically motivated fine-grained mesh-connected computer m...
04/14/2023

CornerFormer: Boosting Corner Representation for Fine-Grained Structured Reconstruction

Structured reconstruction is a non-trivial dense prediction problem, whi...
09/13/2021

Interactive All-Hex Meshing via Cuboid Decomposition

Standard PolyCube-based hexahedral (hex) meshing methods aim to deform t...