A Frequency Domain Constraint for Synthetic X-ray Image Super Resolution

05/14/2021
by   Qing Ma, et al.
0

Synthetic X-ray images can be helpful for image guiding systems and VR simulations. However, it is difficult to produce high-quality arbitrary view synthetic X-ray images in real-time due to limited CT scanning resolution, high computation resource demand or algorithm complexity. Our goal is to generate high-resolution synthetic X-ray images in real-time by upsampling low-resolution im-ages. Reference-based Super Resolution (RefSR) has been well studied in recent years and has been proven to be more powerful than traditional Single Image Su-per-Resolution (SISR). RefSR can produce fine details by utilizing the reference image but it still inevitably generates some artifacts and noise. In this paper, we propose texture transformer super-resolution with frequency domain (TTSR-FD). We introduce frequency domain loss as a constraint to further improve the quality of the RefSR results with fine details and without obvious artifacts. This makes a real-time synthetic X-ray image-guided procedure VR simulation system possible. To the best of our knowledge, this is the first paper utilizing the frequency domain as part of the loss functions in the field of super-resolution. We evaluated TTSR-FD on our synthetic X-ray image dataset and achieved state-of-the-art results.

READ FULL TEXT

page 4

page 7

research
01/26/2017

Super-resolution Using Constrained Deep Texture Synthesis

Hallucinating high frequency image details in single image super-resolut...
research
04/17/2016

Some medical applications of example-based super-resolution

Example-based super-resolution (EBSR) reconstructs a high-resolution ima...
research
12/01/2019

Texture Hallucination for Large-Scale Painting Super-Resolution

We aim to super-resolve digital paintings, synthesizing realistic detail...
research
06/18/2019

Image Super Resolution via Bilinear Pooling: Application to Confocal Endomicroscopy

Recent developments in image acquisition literature have miniaturized th...
research
06/03/2022

Real-Time Super-Resolution for Real-World Images on Mobile Devices

Image Super-Resolution (ISR), which aims at recovering High-Resolution (...
research
09/04/2021

Fast Image-Anomaly Mitigation for Autonomous Mobile Robots

Camera anomalies like rain or dust can severelydegrade image quality and...
research
09/28/2021

Image scaling by de la Vallée-Poussin filtered interpolation

We present a new image scaling method both for downscaling and upscaling...

Please sign up or login with your details

Forgot password? Click here to reset