Generating Synthetic X-ray Images of a Person from the Surface Geometry

by   Brian Teixeira, et al.

We present a novel framework that learns to predict human anatomy from body surface. Specifically, our approach generates a synthetic X-ray image of a person only from the person's surface geometry. Furthermore, the synthetic X-ray image is parametrized and can be manipulated by adjusting a set of body markers which are also generated during the X-ray image prediction. With the proposed framework, multiple synthetic X-ray images can easily be generated by varying surface geometry. By perturbing the parameters, several additional synthetic X-ray images can be generated from the same surface geometry. As a result, our approach offers a potential to overcome the training data barrier in the medical domain. This capability is achieved by learning a pair of networks - one learns to generate the full image from the partial image and a set of parameters, and the other learns to estimate the parameters given the full image. During training, the two networks are trained iteratively such that they would converge to a solution where the predicted parameters and the full image are consistent with each other. In addition to medical data enrichment, our framework can also be used for image completion as well as anomaly detection.


page 1

page 6

page 7

page 8


RANA: Relightable Articulated Neural Avatars

We propose RANA, a relightable and articulated neural avatar for the pho...

Automated Knee X-ray Report Generation

Gathering manually annotated images for the purpose of training a predic...

Deep Learning-based Anomaly Detection on X-ray Images of Fuel Cell Electrodes

Anomaly detection in X-ray images has been an active and lasting researc...

Neural networks trained on synthetically generated crystals can extract structural information from ICSD powder X-ray diffractograms

Machine learning techniques have successfully been used to extract struc...

Effective sparse representation of X-Ray medical images

Effective sparse representation of X-Ray medical images within the conte...

Mixed X-Ray Image Separation for Artworks with Concealed Designs

In this paper, we focus on X-ray images of paintings with concealed sub-...

Ray-marching Thurston geometries

We describe algorithms that produce accurate real-time interactive in-sp...

Please sign up or login with your details

Forgot password? Click here to reset