Learning Ultrasound Rendering from Cross-Sectional Model Slices for Simulated Training

01/20/2021
by   Lin Zhang, et al.
0

Purpose. Given the high level of expertise required for navigation and interpretation of ultrasound images, computational simulations can facilitate the training of such skills in virtual reality. With ray-tracing based simulations, realistic ultrasound images can be generated. However, due to computational constraints for interactivity, image quality typically needs to be compromised. Methods. We propose herein to bypass any rendering and simulation process at interactive time, by conducting such simulations during a non-time-critical offline stage and then learning image translation from cross-sectional model slices to such simulated frames. We use a generative adversarial framework with a dedicated generator architecture and input feeding scheme, which both substantially improve image quality without increase in network parameters. Integral attenuation maps derived from cross-sectional model slices, texture-friendly strided convolutions, providing stochastic noise and input maps to intermediate layers in order to preserve locality are all shown herein to greatly facilitate such translation task. Results. Given several quality metrics, the proposed method with only tissue maps as input is shown to provide comparable or superior results to a state-of-the-art that uses additional images of low-quality ultrasound renderings. An extensive ablation study shows the need and benefits from the individual contributions utilized in this work, based on qualitative examples and quantitative ultrasound similarity metrics. To that end, a local histogram statistics based error metric is proposed and demonstrated for visualization of local dissimilarities between ultrasound images.

READ FULL TEXT

page 1

page 6

page 7

research
06/18/2020

Deep Image Translation for Enhancing Simulated Ultrasound Images

Ultrasound simulation based on ray tracing enables the synthesis of high...
research
03/09/2021

Content-Preserving Unpaired Translation from Simulated to Realistic Ultrasound Images

Interactive simulation of ultrasound imaging greatly facilitates sonogra...
research
02/21/2023

Unpaired Translation from Semantic Label Maps to Images by Leveraging Domain-Specific Simulations

Photorealistic image generation from simulated label maps are necessitat...
research
02/01/2019

SCATGAN for Reconstruction of Ultrasound Scatterers Using Generative Adversarial Networks

Computational simulation of ultrasound (US) echography is essential for ...
research
12/21/2017

Simulating Patho-realistic Ultrasound Images using Deep Generative Networks with Adversarial Learning

Ultrasound imaging makes use of backscattering of waves during their int...
research
02/16/2022

Image translation of Ultrasound to Pseudo Anatomical Display Using Artificial Intelligence

Ultrasound is the second most used modality in medical imaging. It is co...
research
08/09/2021

Explainable AI and susceptibility to adversarial attacks: a case study in classification of breast ultrasound images

Ultrasound is a non-invasive imaging modality that can be conveniently u...

Please sign up or login with your details

Forgot password? Click here to reset