SE-MD: A Single-encoder multiple-decoder deep network for point cloud generation from 2D images

12/30/2021
by   Abdul Mueed Hafiz, et al.
0

3D model generation from single 2D RGB images is a challenging and actively researched computer vision task. Various techniques using conventional network architectures have been proposed for the same. However, the body of research work is limited and there are various issues like using inefficient 3D representation formats, weak 3D model generation backbones, inability to generate dense point clouds, dependence of post-processing for generation of dense point clouds, and dependence on silhouettes in RGB images. In this paper, a novel 2D RGB image to point cloud conversion technique is proposed, which improves the state of art in the field due to its efficient, robust and simple model by using the concept of parallelization in network architecture. It not only uses the efficient and rich 3D representation of point clouds, but also uses a novel and robust point cloud generation backbone in order to address the prevalent issues. This involves using a single-encoder multiple-decoder deep network architecture wherein each decoder generates certain fixed viewpoints. This is followed by fusing all the viewpoints to generate a dense point cloud. Various experiments are conducted on the technique and its performance is compared with those of other state of the art techniques and impressive gains in performance are demonstrated.

READ FULL TEXT

page 4

page 6

page 8

page 9

research
10/07/2021

TreeGCN-ED: Encoding Point Cloud using a Tree-Structured Graph Network

Point cloud is an efficient way of representing and storing 3D geometric...
research
02/28/2022

Variable Rate Compression for Raw 3D Point Clouds

In this paper, we propose a novel variable rate deep compression archite...
research
03/22/2022

Convolutional Neural Network-based Efficient Dense Point Cloud Generation using Unsigned Distance Fields

Dense point cloud generation from a sparse or incomplete point cloud is ...
research
12/22/2019

Learning to Generate Dense Point Clouds with Textures on Multiple Categories

3D reconstruction from images is a core problem in computer vision. With...
research
04/06/2019

Embodied Question Answering in Photorealistic Environments with Point Cloud Perception

To help bridge the gap between internet vision-style problems and the go...
research
07/28/2023

PatchMixer: Rethinking network design to boost generalization for 3D point cloud understanding

The recent trend in deep learning methods for 3D point cloud understandi...
research
03/20/2022

Lateral Ego-Vehicle Control without Supervision using Point Clouds

Existing vision based supervised approaches to lateral vehicle control a...

Please sign up or login with your details

Forgot password? Click here to reset