Real-Time 3D Shape of Micro-Details

by   Maryam Khanian, et al.

Motivated by the growing demand for interactive environments, we propose an accurate real-time 3D shape reconstruction technique. To provide a reliable 3D reconstruction which is still a challenging task when dealing with real-world applications, we integrate several components including (i) Photometric Stereo (PS), (ii) perspective Cook-Torrance reflectance model that enables PS to deal with a broad range of possible real-world object reflections, (iii) realistic lightening situation, (iv) a Recurrent Optimization Network (RON) and finally (v) heuristic Dijkstra Gaussian Mean Curvature (DGMC) initialization approach. We demonstrate the potential benefits of our hybrid model by providing 3D shape with highly-detailed information from micro-prints for the first time. All real-world images are taken by a mobile phone camera under a simple setup as a consumer-level equipment. In addition, complementary synthetic experiments confirm the beneficial properties of our novel method and its superiority over the state-of-the-art approaches.


page 1

page 3

page 11

page 12

page 13


Photometric stereo for strong specular highlights

Photometric stereo (PS) is a fundamental technique in computer vision kn...

Two-shot Spatially-varying BRDF and Shape Estimation

Capturing the shape and spatially-varying appearance (SVBRDF) of an obje...

Real-time Pose and Shape Reconstruction of Two Interacting Hands With a Single Depth Camera

We present a novel method for real-time pose and shape reconstruction of...

Depth from a polarisation + RGB stereo pair

In this paper, we propose a hybrid depth imaging system in which a polar...

A novel 3D display based on micro-volumetric scanning and real time reconstruction of holograms principle

The present study proposes a novel 3D display contains a micro-volumetri...

Secrets of 3D Implicit Object Shape Reconstruction in the Wild

Reconstructing high-fidelity 3D objects from sparse, partial observation...

Please sign up or login with your details

Forgot password? Click here to reset