One-stage Shape Instantiation from a Single 2D Image to 3D Point Cloud

07/24/2019
by   Xiao-Yun Zhou, et al.
0

Shape instantiation which predicts the 3D shape of a dynamic target from one or more 2D images is important for real-time intra-operative navigation. Previously, a general shape instantiation framework was proposed with manual image segmentation to generate a 2D Statistical Shape Model (SSM) and with Kernel Partial Least Square Regression (KPLSR) to learn the relationship between the 2D and 3D SSM for 3D shape prediction. In this paper, the two-stage shape instantiation is improved to be one-stage. PointOutNet with 19 convolutional layers and three fully-connected layers is used as the network structure and Chamfer distance is used as the loss function to predict the 3D target point cloud from a single 2D image. With the proposed one-stage shape instantiation algorithm, a spontaneous image-to-point cloud training and inference can be achieved. A dataset from 27 Right Ventricle (RV) subjects, indicating 609 experiments, were used to validate the proposed one-stage shape instantiation algorithm. An average point cloud-to-point cloud (PC-to-PC) error of 1.72mm has been achieved, which is comparable to the PLSR-based (1.42mm) and KPLSR-based (1.31mm) two-stage shape instantiation algorithm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/16/2019

Instantiation-Net: 3D Mesh Reconstruction from Single 2D Image for Right Ventricle

3D shape instantiation which reconstructs the 3D shape of a target from ...
research
09/08/2018

RealPoint3D: Point Cloud Generation from a Single Image with Complex Background

3D point cloud generation by the deep neural network from a single image...
research
12/25/2022

Neural Shape Compiler: A Unified Framework for Transforming between Text, Point Cloud, and Program

3D shapes have complementary abstractions from low-level geometry to par...
research
11/02/2019

Anthropometric clothing measurements from 3D body scans

We propose a full processing pipeline to acquire anthropometric measurem...
research
12/30/2017

A Real-time and Registration-free Framework for Dynamic Shape Instantiation

Real-time 3D navigation during minimally invasive procedures is an essen...
research
07/13/2016

Fitting a Simplicial Complex using a Variation of k-means

We give a simple and effective two stage algorithm for approximating a p...
research
11/15/2019

GraphX-Convolution for Point Cloud Deformation in 2D-to-3D Conversion

In this paper, we present a novel deep method to reconstruct a point clo...

Please sign up or login with your details

Forgot password? Click here to reset