RealPoint3D: Point Cloud Generation from a Single Image with Complex Background

09/08/2018
by   Yan Xia, et al.
0

3D point cloud generation by the deep neural network from a single image has been attracting more and more researchers' attention. However, recently-proposed methods require the objects be captured with relatively clean backgrounds, fixed viewpoint, while this highly limits its application in the real environment. To overcome these drawbacks, we proposed to integrate the prior 3D shape knowledge into the network to guide the 3D generation. By taking additional 3D information, the proposed network can handle the 3D object generation from a single real image captured from any viewpoint and complex background. Specifically, giving a query image, we retrieve the nearest shape model from a pre-prepared 3D model database. Then, the image together with the retrieved shape model is fed into the proposed network to generate the fine-grained 3D point cloud. The effectiveness of our proposed framework has been verified on different kinds of datasets. Experimental results show that the proposed framework achieves state-of-the-art accuracy compared to other volumetric-based and point set generation methods. Furthermore, the proposed framework works well for real images in complex backgrounds with various view angles.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 7

research
07/24/2019

One-stage Shape Instantiation from a Single 2D Image to 3D Point Cloud

Shape instantiation which predicts the 3D shape of a dynamic target from...
research
06/30/2020

Method for the generation of depth images for view-based shape retrieval of 3D CAD model from partial point cloud

A laser scanner can easily acquire the geometric data of physical enviro...
research
08/31/2023

BuilDiff: 3D Building Shape Generation using Single-Image Conditional Point Cloud Diffusion Models

3D building generation with low data acquisition costs, such as single i...
research
11/11/2017

End-to-end 3D shape inverse rendering of different classes of objects from a single input image

In this paper a semi-supervised deep framework is proposed for the probl...
research
11/15/2019

GraphX-Convolution for Point Cloud Deformation in 2D-to-3D Conversion

In this paper, we present a novel deep method to reconstruct a point clo...
research
08/17/2021

Visual Enhanced 3D Point Cloud Reconstruction from A Single Image

Solving the challenging problem of 3D object reconstruction from a singl...
research
02/27/2020

Improving Learning Effectiveness For Object Detection and Classification in Cluttered Backgrounds

Usually, Neural Networks models are trained with a large dataset of imag...

Please sign up or login with your details

Forgot password? Click here to reset