MMSR: Multiple-Model Learned Image Super-Resolution Benefiting From Class-Specific Image Priors

09/18/2022
by   Cansu Korkmaz, et al.
0

Assuming a known degradation model, the performance of a learned image super-resolution (SR) model depends on how well the variety of image characteristics within the training set matches those in the test set. As a result, the performance of an SR model varies noticeably from image to image over a test set depending on whether characteristics of specific images are similar to those in the training set or not. Hence, in general, a single SR model cannot generalize well enough for all types of image content. In this work, we show that training multiple SR models for different classes of images (e.g., for text, texture, etc.) to exploit class-specific image priors and employing a post-processing network that learns how to best fuse the outputs produced by these multiple SR models surpasses the performance of state-of-the-art generic SR models. Experimental results clearly demonstrate that the proposed multiple-model SR (MMSR) approach significantly outperforms a single pre-trained state-of-the-art SR model both quantitatively and visually. It even exceeds the performance of the best single class-specific SR model trained on similar text or texture images.

READ FULL TEXT

page 1

page 4

research
06/13/2022

Learning a Degradation-Adaptive Network for Light Field Image Super-Resolution

Recent years have witnessed the great advances of deep neural networks (...
research
07/06/2021

From General to Specific: Online Updating for Blind Super-Resolution

Most deep learning-based super-resolution (SR) methods are not image-spe...
research
04/08/2020

Learning for Scale-Arbitrary Super-Resolution from Scale-Specific Networks

Recently, the performance of single image super-resolution (SR) has been...
research
01/13/2022

Flexible Style Image Super-Resolution using Conditional Objective

Recent studies have significantly enhanced the performance of single-ima...
research
04/20/2023

NTIRE 2023 Challenge on Light Field Image Super-Resolution: Dataset, Methods and Results

In this report, we summarize the first NTIRE challenge on light field (L...
research
04/22/2015

Self-Tuned Deep Super Resolution

Deep learning has been successfully applied to image super resolution (S...
research
12/30/2019

Characteristic Regularisation for Super-Resolving Face Images

Existing facial image super-resolution (SR) methods focus mostly on impr...

Please sign up or login with your details

Forgot password? Click here to reset