Flow-based GAN for 3D Point Cloud Generation from a Single Image

10/08/2022
by   Yao Wei, et al.
0

Generating a 3D point cloud from a single 2D image is of great importance for 3D scene understanding applications. To reconstruct the whole 3D shape of the object shown in the image, the existing deep learning based approaches use either explicit or implicit generative modeling of point clouds, which, however, suffer from limited quality. In this work, we aim to alleviate this issue by introducing a hybrid explicit-implicit generative modeling scheme, which inherits the flow-based explicit generative models for sampling point clouds with arbitrary resolutions while improving the detailed 3D structures of point clouds by leveraging the implicit generative adversarial networks (GANs). We evaluate on the large-scale synthetic dataset ShapeNet, with the experimental results demonstrating the superior performance of the proposed method. In addition, the generalization ability of our method is demonstrated by performing on cross-category synthetic images as well as by testing on real images from PASCAL3D+ dataset.

READ FULL TEXT

page 8

page 9

research
02/26/2023

Generative Models for 3D Point Clouds

Point clouds are rich geometric data structures, where their three dimen...
research
10/12/2018

Point Cloud Colorization Based on Densely Annotated 3D Shape Dataset

This paper introduces DensePoint, a densely sampled and annotated point ...
research
05/22/2023

SG-GAN: Fine Stereoscopic-Aware Generation for 3D Brain Point Cloud Up-sampling from a Single Image

In minimally-invasive brain surgeries with indirect and narrow operating...
research
12/15/2019

C-Flow: Conditional Generative Flow Models for Images and 3D Point Clouds

Flow-based generative models have highly desirable properties like exact...
research
10/13/2018

Point Cloud GAN

Generative Adversarial Networks (GAN) can achieve promising performance ...
research
08/17/2021

Visual Enhanced 3D Point Cloud Reconstruction from A Single Image

Solving the challenging problem of 3D object reconstruction from a singl...
research
12/04/2019

Spectral-GANs for High-Resolution 3D Point-cloud Generation

Point-clouds are a popular choice for vision and graphics tasks due to t...

Please sign up or login with your details

Forgot password? Click here to reset