Toward 3D Object Reconstruction from Stereo Images

10/18/2019
by   Hongxun Yao, et al.
39

Inferring the 3D shape of an object from an RGB image has shown impressive results, however, existing methods rely primarily on recognizing the most similar 3D model from the training set to solve the problem. These methods suffer from poor generalization and may lead to low-quality reconstructions for unseen objects. Nowadays, stereo cameras are pervasive in emerging devices such as dual-lens smartphones and robots, which enables the use of the two-view nature of stereo images to explore the 3D structure and thus improve the reconstruction performance. In this paper, we propose a new deep learning framework for reconstructing the 3D shape of an object from a pair of stereo images, which reasons about the 3D structure of the object by taking bidirectional disparities and feature correspondences between the two views into account. Besides, we present a large-scale synthetic benchmarking dataset, namely StereoShapeNet, containing 1,052,976 pairs of stereo images rendered from ShapeNet along with the corresponding bidirectional depth and disparity maps. Experimental results on the StereoShapeNet benchmark demonstrate that the proposed framework outperforms the state-of-the-art methods.

READ FULL TEXT

page 1

page 3

page 5

page 6

research
04/10/2019

DAVANet: Stereo Deblurring with View Aggregation

Nowadays stereo cameras are more commonly adopted in emerging devices su...
research
06/25/2017

Photometric Stereo by Hemispherical Metric Embedding

Photometric Stereo methods seek to reconstruct the 3d shape of an object...
research
09/26/2018

DSR: Direct Self-rectification for Uncalibrated Dual-lens Cameras

With the developments of dual-lens camera modules,depth information repr...
research
03/11/2021

Unknown Object Segmentation from Stereo Images

Although instance-aware perception is a key prerequisite for many autono...
research
11/04/2017

Object-Centric Photometric Bundle Adjustment with Deep Shape Prior

Reconstructing 3D shapes from a sequence of images has long been a probl...
research
04/09/2018

Photometric Stereo in Participating Media Considering Shape-Dependent Forward Scatter

Images captured in participating media such as murky water, fog, or smok...
research
03/08/2020

Meta3D: Single-View 3D Object Reconstruction from Shape Priors in Memory

3D shape reconstruction from a single-view RGB image is an ill-posed pro...

Please sign up or login with your details

Forgot password? Click here to reset