Intraoperative Organ Motion Models with an Ensemble of Conditional Generative Adversarial Networks

09/05/2017
by   Yipeng Hu, et al.
0

In this paper, we describe how a patient-specific, ultrasound-probe-induced prostate motion model can be directly generated from a single preoperative MR image. Our motion model allows for sampling from the conditional distribution of dense displacement fields, is encoded by a generative neural network conditioned on a medical image, and accepts random noise as additional input. The generative network is trained by a minimax optimisation with a second discriminative neural network, tasked to distinguish generated samples from training motion data. In this work, we propose that 1) jointly optimising a third conditioning neural network that pre-processes the input image, can effectively extract patient-specific features for conditioning; and 2) combining multiple generative models trained separately with heuristically pre-disjointed training data sets can adequately mitigate the problem of mode collapse. Trained with diagnostic T2-weighted MR images from 143 real patients and 73,216 3D dense displacement fields from finite element simulations of intraoperative prostate motion due to transrectal ultrasound probe pressure, the proposed models produced physically-plausible patient-specific motion of prostate glands. The ability to capture biomechanically simulated motion was evaluated using two errors representing generalisability and specificity of the model. The median values, calculated from a 10-fold cross-validation, were 2.8+/-0.3 mm and 1.7+/-0.1 mm, respectively. We conclude that the introduced approach demonstrates the feasibility of applying state-of-the-art machine learning algorithms to generate organ motion models from patient images, and shows significant promise for future research.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 4

page 7

page 8

07/17/2017

Freehand Ultrasound Image Simulation with Spatially-Conditioned Generative Adversarial Networks

Sonography synthesis has a wide range of applications, including medical...
07/09/2020

Prostate motion modelling using biomechanically-trained deep neural networks on unstructured nodes

In this paper, we propose to train deep neural networks with biomechanic...
05/27/2018

Adversarial Deformation Regularization for Training Image Registration Neural Networks

We describe an adversarial learning approach to constrain convolutional ...
06/30/2019

Conditional Segmentation in Lieu of Image Registration

Classical pairwise image registration methods search for a spatial trans...
11/30/2021

FMD-cGAN: Fast Motion Deblurring using Conditional Generative Adversarial Networks

In this paper, we present a Fast Motion Deblurring-Conditional Generativ...
06/21/2021

Leveraging Conditional Generative Models in a General Explanation Framework of Classifier Decisions

Providing a human-understandable explanation of classifiers' decisions h...
09/16/2020

Geometric Uncertainty in Patient-Specific Cardiovascular Modeling with Convolutional Dropout Networks

We propose a novel approach to generate samples from the conditional dis...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.