Perception Consistency Ultrasound Image Super-resolution via Self-supervised CycleGAN

12/28/2020
by   Heng Liu, et al.
1

Due to the limitations of sensors, the transmission medium and the intrinsic properties of ultrasound, the quality of ultrasound imaging is always not ideal, especially its low spatial resolution. To remedy this situation, deep learning networks have been recently developed for ultrasound image super-resolution (SR) because of the powerful approximation capability. However, most current supervised SR methods are not suitable for ultrasound medical images because the medical image samples are always rare, and usually, there are no low-resolution (LR) and high-resolution (HR) training pairs in reality. In this work, based on self-supervision and cycle generative adversarial network (CycleGAN), we propose a new perception consistency ultrasound image super-resolution (SR) method, which only requires the LR ultrasound data and can ensure the re-degenerated image of the generated SR one to be consistent with the original LR image, and vice versa. We first generate the HR fathers and the LR sons of the test ultrasound LR image through image enhancement, and then make full use of the cycle loss of LR-SR-LR and HR-LR-SR and the adversarial characteristics of the discriminator to promote the generator to produce better perceptually consistent SR results. The evaluation of PSNR/IFC/SSIM, inference efficiency and visual effects under the benchmark CCA-US and CCA-US datasets illustrate our proposed approach is effective and superior to other state-of-the-art methods.

READ FULL TEXT

page 1

page 7

page 8

research
09/07/2020

Deep Cyclic Generative Adversarial Residual Convolutional Networks for Real Image Super-Resolution

Recent deep learning based single image super-resolution (SISR) methods ...
research
04/08/2023

Towards Realistic Ultrasound Fetal Brain Imaging Synthesis

Prenatal ultrasound imaging is the first-choice modality to assess fetal...
research
09/02/2023

Constrained CycleGAN for Effective Generation of Ultrasound Sector Images of Improved Spatial Resolution

Objective. A phased or a curvilinear array produces ultrasound (US) imag...
research
08/15/2023

CMISR: Circular Medical Image Super-Resolution

Classical methods of medical image super-resolution (MISR) utilize open-...
research
02/07/2018

Super-resolution of spatiotemporal event-based image

Super-resolution (SR) is a useful technology to generate a high-resoluti...
research
05/19/2021

XCycles Backprojection Acoustic Super-Resolution

The computer vision community has paid much attention to the development...
research
12/30/2019

Characteristic Regularisation for Super-Resolving Face Images

Existing facial image super-resolution (SR) methods focus mostly on impr...

Please sign up or login with your details

Forgot password? Click here to reset