Differentiable Refraction-Tracing for Mesh Reconstruction of Transparent Objects

09/19/2020
by   Jiahui Lyu, et al.
0

Capturing the 3D geometry of transparent objects is a challenging task, ill-suited for general-purpose scanning and reconstruction techniques, since these cannot handle specular light transport phenomena. Existing state-of-the-art methods, designed specifically for this task, either involve a complex setup to reconstruct complete refractive ray paths, or leverage a data-driven approach based on synthetic training data. In either case, the reconstructed 3D models suffer from over-smoothing and loss of fine detail. This paper introduces a novel, high precision, 3D acquisition and reconstruction method for solid transparent objects. Using a static background with a coded pattern, we establish a mapping between the camera view rays and locations on the background. Differentiable tracing of refractive ray paths is then used to directly optimize a 3D mesh approximation of the object, while simultaneously ensuring silhouette consistency and smoothness. Extensive experiments and comparisons demonstrate the superior accuracy of our method.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 2

page 3

page 6

page 9

page 10

page 11

page 12

page 13

05/20/2021

Dense Reconstruction of Transparent Objects by Altering Incident Light Paths Through Refraction

This paper addresses the problem of reconstructing the surface shape of ...
05/09/2018

Full 3D Reconstruction of Transparent Objects

Numerous techniques have been proposed for reconstructing 3D models for ...
04/22/2020

Through the Looking Glass: Neural 3D Reconstruction of Transparent Shapes

Recovering the 3D shape of transparent objects using a small number of u...
01/13/2021

Practical Face Reconstruction via Differentiable Ray Tracing

We present a differentiable ray-tracing based novel face reconstruction ...
12/06/2020

Shape From Tracing: Towards Reconstructing 3D Object Geometry and SVBRDF Material from Images via Differentiable Path Tracing

Reconstructing object geometry and material from multiple views typicall...
01/23/2021

Next-best-view Regression using a 3D Convolutional Neural Network

Automated three-dimensional (3D) object reconstruction is the task of bu...
10/03/2019

Face Reflectance and Geometry Modeling via Differentiable Ray Tracing

We present a novel strategy to automatically reconstruct 3D faces from m...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.