End-To-End Convolutional Neural Network for 3D Reconstruction of Knee Bones From Bi-Planar X-Ray Images

04/02/2020
by   Yoni Kasten, et al.
0

We present an end-to-end Convolutional Neural Network (CNN) approach for 3D reconstruction of knee bones directly from two bi-planar X-ray images. Clinically, capturing the 3D models of the bones is crucial for surgical planning, implant fitting, and postoperative evaluation. X-ray imaging significantly reduces the exposure of patients to ionizing radiation compared to Computer Tomography (CT) imaging, and is much more common and inexpensive compared to Magnetic Resonance Imaging (MRI) scanners. However, retrieving 3D models from such 2D scans is extremely challenging. In contrast to the common approach of statistically modeling the shape of each bone, our deep network learns the distribution of the bones' shapes directly from the training images. We train our model with both supervised and unsupervised losses using Digitally Reconstructed Radiograph (DRR) images generated from CT scans. To apply our model to X-Ray data, we use style transfer to transform between X-Ray and DRR modalities. As a result, at test time, without further optimization, our solution directly outputs a 3D reconstruction from a pair of bi-planar X-ray images, while preserving geometric constraints. Our results indicate that our deep learning model is very efficient, generalizes well and produces high quality reconstructions.

READ FULL TEXT

page 5

page 11

page 12

research
01/16/2019

MRI to CT Translation with GANs

We present a detailed description and reference implementation of prepro...
research
08/04/2023

CT Reconstruction from Few Planar X-rays with Application towards Low-resource Radiotherapy

CT scans are the standard-of-care for many clinical ailments, and are ne...
research
03/21/2023

Oral-NeXF: 3D Oral Reconstruction with Neural X-ray Field from Panoramic Imaging

3D reconstruction of medical images from 2D images has increasingly beco...
research
08/23/2022

Structure Regularized Attentive Network for Automatic Femoral Head Necrosis Diagnosis and Localization

In recent years, several works have adopted the convolutional neural net...
research
02/27/2018

Translating and Segmenting Multimodal Medical Volumes with Cycle- and Shape-Consistency Generative Adversarial Network

Synthesized medical images have several important applications, e.g., as...
research
06/23/2020

3D Probabilistic Segmentation and Volumetry from 2D projection images

X-Ray imaging is quick, cheap and useful for front-line care assessment ...
research
03/18/2020

Graph Attention Network based Pruning for Reconstructing 3D Liver Vessel Morphology from Contrasted CT Images

With the injection of contrast material into blood vessels, multi-phase ...

Please sign up or login with your details

Forgot password? Click here to reset