Joint Generative Learning and Super-Resolution For Real-World Camera-Screen Degradation

08/01/2020
by   Guanghao Yin, et al.
0

In real-world single image super-resolution (SISR) task, the low-resolution image suffers more complicated degradations, not only downsampled by unknown kernels. However, existing SISR methods are generally studied with the synthetic low-resolution generation such as bicubic interpolation (BI), which greatly limits their performance. Recently, some researchers investigate real-world SISR from the perspective of the camera and smartphone. However, except the acquisition equipment, the display device also involves more complicated degradations. In this paper, we focus on the camera-screen degradation and build a real-world dataset (Cam-ScreenSR), where HR images are original ground truths from the previous DIV2K dataset and corresponding LR images are camera-captured versions of HRs displayed on the screen. We conduct extensive experiments to demonstrate that involving more real degradations is positive to improve the generalization of SISR models. Moreover, we propose a joint two-stage model. Firstly, the downsampling degradation GAN(DD-GAN) is trained to model the degradation and produces more various of LR images, which is validated to be efficient for data augmentation. Then the dual residual channel attention network (DuRCAN) learns to recover the SR image. The weighted combination of L1 loss and proposed Laplacian loss are applied to sharpen the high-frequency edges. Extensive experimental results in both typical synthetic and complicated real-world degradations validate the proposed method outperforms than existing SOTA models with less parameters, faster speed and better visual results. Moreover, in real captured photographs, our model also delivers best visual quality with sharper edge, less artifacts, especially appropriate color enhancement, which has not been accomplished by previous methods.

READ FULL TEXT

page 2

page 4

page 9

page 10

page 11

page 12

page 13

page 14

research
04/01/2019

Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Model

Most of the existing learning-based single image superresolution (SISR) ...
research
12/15/2022

DCS-RISR: Dynamic Channel Splitting for Efficient Real-world Image Super-Resolution

Real-world image super-resolution (RISR) has received increased focus fo...
research
04/13/2020

Multi-modal Datasets for Super-resolution

Nowdays, most datasets used to train and evaluate super-resolution model...
research
05/20/2020

Iterative Network for Image Super-Resolution

Single image super-resolution (SISR), as a traditional ill-conditioned i...
research
11/05/2021

Frequency-Aware Physics-Inspired Degradation Model for Real-World Image Super-Resolution

Current learning-based single image super-resolution (SISR) algorithms u...
research
04/19/2021

Removing Diffraction Image Artifacts in Under-Display Camera via Dynamic Skip Connection Network

Recent development of Under-Display Camera (UDC) systems provides a true...
research
04/11/2018

Demoiréing of Camera-Captured Screen Images Using Deep Convolutional Neural Network

Taking photos of optoelectronic displays is a direct and spontaneous way...

Please sign up or login with your details

Forgot password? Click here to reset