Projection-to-Projection Translation for Hybrid X-ray and Magnetic Resonance Imaging

by   Bernhard Stimpel, et al.

Hybrid X-ray and magnetic resonance (MR) imaging promises large potential in interventional medical imaging applications due to the broad variety of contrast of MRI combined with fast imaging of X-ray-based modalities. To fully utilize the potential of the vast amount of existing image enhancement techniques, the corresponding information from both modalities must be present in the same domain. For image-guided interventional procedures, X-ray fluoroscopy has proven to be the modality of choice. Synthesizing one modality from another in this case is an ill-posed problem due to ambiguous signal and overlapping structures in projective geometry. To take on these challenges, we present a learning-based solution to MR to X-ray projection-to-projection translation. We propose an image generator network that focuses on high representation capacity in higher resolution layers to allow for accurate synthesis of fine details in the projection images. Additionally, a weighting scheme in the loss computation that favors high-frequency structures is proposed to focus on the important details and contours in projection imaging. The proposed extensions prove valuable in generating X-ray projection images with natural appearance. Our approach achieves a deviation from the ground truth of only 6 particular the high frequency weighting assists in generating projection images with sharp appearance and reduces erroneously synthesized fine details.



There are no comments yet.


page 1

page 3

page 5

page 7

page 8


MR to X-Ray Projection Image Synthesis

Hybrid imaging promises large potential in medical imaging applications....

Projection image-to-image translation in hybrid X-ray/MR imaging

The potential benefit of hybrid X-ray and MR imaging in the intervention...

A 3-D Projection Model for X-ray Dark-field Imaging

Talbot-Lau X-ray phase-contrast imaging is a novel imaging modality, whi...

FREA-Unet: Frequency-aware U-net for Modality Transfer

While Positron emission tomography (PET) imaging has been widely used in...

X-ray In-Depth Decomposition: Revealing The Latent Structures

X-ray radiography is the most readily available imaging modality and has...

Azimuthal Anamorphic Ray-map for Immersive Renders in Perspective

Wide choice of cinematic lenses enables motion-picture creators to adapt...

Learning Priors in High-frequency Domain for Inverse Imaging Reconstruction

Ill-posed inverse problems in imaging remain an active research topic in...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.