Robust Super-Resolution GAN, with Manifold-based and Perception Loss

03/16/2019
by   Uddeshya Upadhyay, et al.
0

Super-resolution using deep neural networks typically relies on highly curated training sets that are often unavailable in clinical deployment scenarios. Using loss functions that assume Gaussian-distributed residuals makes the learning sensitive to corruptions in clinical training sets. We propose novel loss functions that are robust to corruptions in training sets by modeling heavy-tailed non-Gaussian distributions on the residuals. We propose a loss based on an autoencoder-based manifold-distance between the super-resolved and high-resolution images, to reproduce realistic textural content in super-resolved images. We propose to learn to super-resolve images to match human perceptions of structure, luminance, and contrast. Results on a large clinical dataset shows the advantages of each of our contributions, where our framework improves over the state of the art.

READ FULL TEXT
research
07/24/2022

Improved Super Resolution of MR Images Using CNNs and Vision Transformers

State of the art magnetic resonance (MR) image super-resolution methods ...
research
08/13/2020

Revisiting Temporal Modeling for Video Super-resolution

Video super-resolution plays an important role in surveillance video ana...
research
05/03/2020

Joint-SRVDNet: Joint Super Resolution and Vehicle Detection Network

In many domestic and military applications, aerial vehicle detection and...
research
11/23/2018

Temporally Coherent GANs for Video Super-Resolution (TecoGAN)

Adversarial training has been highly successful in the context of image ...
research
12/30/2019

Multi-modality super-resolution loss for GAN-based super-resolution of clinical CT images using micro CT image database

This paper newly introduces multi-modality loss function for GAN-based s...
research
07/30/2020

Very Deep Super-Resolution of Remotely Sensed Images with Mean Square Error and Var-norm Estimators as Loss Functions

In this work, very deep super-resolution (VDSR) method is presented for ...
research
12/06/2021

A Dataset-free Self-supervised Disentangled Learning Method for Adaptive Infrared and Visible Images Super-resolution Fusion

This study proposes a novel general dataset-free self-supervised learnin...

Please sign up or login with your details

Forgot password? Click here to reset